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INTRODUCTION 


The  following  report  summarizes  our  activities  under  the  Ofnce  of  Naval  Re¬ 
search  (DARPA)  Contract  No.  N0014-88-K-0657.  We  have  organized  this  report 
under  the  following  five  categories; 

1.  Deliverables:  computer  tape  and  disk  with  instructions,  and  sununary  of  ac¬ 
complishments  related  to  the  proposed  projects. 

II.  List  of  publications  for  the  period  of  this  report. 

III.  .4ppended  respective  reprints  and  preprints. 
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1.  Deliverables:  Computer  Tape  and  Disk  with  Instructions 
and  Summary  of  Accomplishments  Related  to  the  Proposed  Projects 


PROJECT  I 


Deliverable:  Wt  are  dtJivering  a  tape  with  a  software  package  for  UNIX  worksta¬ 
tions  with  documentation  for  analyzing  low  dimensional  dynamical  behavior  from 
time  series.  In  particular,  the  Lyapunov  exponent  code  will,  together  with  the  di¬ 
mension  code,  permit  the  user  to  distinguish  between  periodic,  chaotic,  and  random 
processes.  “Random  processes"  here  means  behavior  whose  dimension  is  too  high 
to  compute.  The  code  computes  the  information  dimension  of  the  time  series.  We 
are  also  including  in  the  same  tape  a  noise-reduction  code  with  documentation. 

Summary  of  Project  1:  Nonlinear  Noise  Filtering  of  Experim  ental  Data  from  Chaotic 
Processes 

Many  attempts  have  been  made  to  apply  ideas  from  dynamical  systems  to  the 
analysis  of  experimental  data  including  estimates  of  attractor  dimension  and  mea¬ 
surement  of  Lyapunov  exponents.  An  essential  problem  is  that  noise  often  compli¬ 
cates  the  analysis.  For  example,  noise  obscures  the  fractal  structure  of  the  attrac¬ 
tor,  so  that  estimates  of  the  attractor  dimension  c;ui  be  difficult  to  obtain.  Various 
methods  have  been  proposed  to  estimate  the  noise  levels  in  the  data,  and  these 
are  useful  for  determining  the  smallest  scales  at  which  dimension  measurements  are 
feasible.  However,  up  until  now  no  systematic  method  has  been  developed  for  noise 
reduction. 

We  have  developed  a  method  which  we  believe  is  a  potential  breakthrough  in  the 
analysis  of  experimental  data.  Typically,  attractors  are  reconstructed  from  a  scalar' 
time  series  of  experimental  data  using  time  delays.  Conventional  signal  filtering 
techniques  are  not  useful  in  this  ca.se,  because  they  examine  only  portions  of  the 
signal  which  are  close  in  time.  We  examine  points  on  an  attractor  which  are  close  in 
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phase  space;  the  corresponding  parts  of  the  original  signal  in  general  are  far  apart 
in  time. 

Our  rnethod  is  a  linearization  technique  which  uses  the  dynamics  of  the  recon¬ 
structed  attractor  to  estimate  and  correct  errors  in  the  trajectories.  The  method 
relies  on  the  assumption  that  in  a  small  neighborhood  about  a  point  on  the  tra¬ 
jectory.  the  dynamics  on  the  attractor  is  nearly  linear.  In  other  words,  given  a 
point  X.  on  the  attractor,  its  image  is  x,+i  =  f(x,)  for  some  nonlinear,  imknown 
function  f.  We  assuire  that  it  is  possible  to  find  a  matrix  A  and  a  vector  b  sucli 
that  x,+i  Rs  Ax,  +  b.  The  method  hcis  two  steps:  first,  to  compute  the  matrices  A 
and  vectors  b  for  each  point  on  the  trajectory,  and  second,  to  find  a  new  trajectory 
near  the  original  one  which  best  satisfies  the  linear  approximation.  We  believe  that 
a  reliable  procedure  like  the  one  outlined  above  will  be  invaluable  for  the  analysis 
of  experimental  data. 
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PROJECT  2 


Deliverable:  We  are  delivering  a  disk  containing  a  Dynamics  code  (for  IBM  com¬ 
patible  PCs  and  for  UNIX/X  window  workstations)  with  a  Manual  for  computing 
and  evaluating  dynamiceJ  processes.  The  source  code  contains  20,000  lines  of  code. 
In  particular,  the  program  will  compute  stable  and  unstable  manifolds  as  described 
below. 

Summary  of  Project  2:  A  fast  Reliable  Method  for  the  Numerical  Computation  of 
Stable  Manifolds  of  Chaotic  Pi  ocesses 

Saddle  points  often  play  a  crucial  role  in  the  dynamics  of  a  particular  map  f.  A 
schematic  illustration  of  a  saddle  pi.'int  in  two  dimensions  is  given  in  the  following 
figure; 


Because  p  is  an  unstable  fixed  point,  cmy  point  p'  eventually  moves  away  from 
p  as  f  is  iterated,  even  though  f(p)  =  p.  For  example,  in  Fig.  1,  initial  conditions 
slightly  to  the  right  of  the  curve  labeled  S  move  toward  p  for  a  few  iterates,  then 
are  repelled  to  the  right  thereafter,  eventually  approacJring  the  curve  U.  Initial 
conditions  slightlj'  to  the  left  of  S  will  move  close  to  p,  then  off  to  the  left.  The 
curve  S  is  the  stable  manifold  of  p:  it  is  the  set  of  initial  conditions  which  are 
attracted  to  p.  The  curve  U  is  the  unstable  manifold.  If  f  is  invertible  then  U  is  the 
stable  manifold  of  p  for  the  inverse  map  f“h  More  generally,  U  is  the  set  of  points 
whose  preimages  tend  to  p. 
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In  many  cases,  the  stable  and  unstable  manifolds  wind  around  in  complicated 
ways.  Because  the  manifolds  are  intertwined  so  closely,  initial  conditions  can  ap¬ 
proach  and  be  repelled  from  the  saddle  point  repeatedly,  leading  to  complex  behav¬ 
ior.  Stable  manifolds  of  fixed  points  often  form  part  of  the  boundary  between  two 
basins  of  attraction.  In  this  case,  the  structure  of  the  stable  manifold  determines 
3  low  sensitive  the  system  is  to  small  errors  in  measuring  an  initial  condition.  In 
addition,  it  is  often  important  to  know  whether  the  stable  and  unstable  manifolds 
cross  at  a  point  other  than  the  saddle  point  p.  Such  homoclinic  intersections  are 
often  of  interest,  especially  in  cases  where  the  map  depends  on  a  parameter.  Hence, 
a  knowledge  of  the  structure  of  the  stable  and  unstable  manifolds  is  essential  to  un¬ 
derstanding  the  dynamics.  VVe  have  developed  efficient,  reliable  numerical  methods 
to  calculate  them. 
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A  novel  method  is  destnbed  for  noise  reduction  in  chaotic  experimental  data  vchose  dvnamics  arc  low  dimensional  In 
adiition.  eve  show  how  the  approach  allows  expenmentahsts  to  use  nanv  of  the  same  techniques  that  base  been  essential  for 
the  analysis  of  nonlinear  system^s  of  ordinary  difTerential  equations  and  diilcrence  equations. 


1.  Introduction 

Numerical  computation  and  computer  graphics 
have  been  essential  tools  for  investigating  the  be¬ 
havior  of  nonlinear  maps  and  difTerential  equa¬ 
tions.  The  pioneering  work  of  Lorenz  (25)  w'as 
made  possible  by  numencal  integration  on  a  com¬ 
puter.  allow'ing  him  to  take  nearby  pairs  of  initial 
conditions  and  compare  the  trajectories.  Henon 
(19)  discovered  ihe  complex  dynamics  of  his  cele¬ 
brated  quadratic  map  with  the  aid  of  a  pro¬ 
grammable  calculator.  A  variety  of  classical  and 
modern  techniques  has  been  exploited  to  find  peri¬ 
odic  orbits,  their  stable  and  unstable  manifolds 
(14),  basins  of  attraction  (26),  fractal  dimension 
[27],  and  Lyapunov  exponents  [10.  31.  37).  In 
.some  cases,  numerical  methods  can  establish  rig- 
orouoly  the  existence  of  initial  conditions  whose 
trajectories  have  essentially  the  same  intricate 
structure  that  one  sees  on  a  computer  screen  (18). 

‘  Curient  address  Department  of  Mathematics.  Anzona  State 
Umversity.  Tempe.  AZ  85287.  USA 


Until  recently,  experimentalists  have  not  been 
able  to  apply  most  of  these  methods  to  the  analy¬ 
sis  of  experimental  data,  since  they  do  not  in 
genet al  have  explicit  equations  to  model  the  be¬ 
havior  of  the':  apparatus.  In  ^ases  where  it  is 
possible  to  find  accurate  models  of  the  physical 
system,  quantitative  predictions  about  the  behav¬ 
ior  of  actual  e.xperiments  are  possible  [17].  How¬ 
ever.  all  that  IS  available  in  a  typicul  experiment  is 
the  time-dependent  output  (e.g.  voltage)  from  one 
or  more  probes,  w  hich  is  a  function  of  the  dynam¬ 
ics. 

One  fundamental  problem  in  the  analysis  of 
experimental  data  concerns  the  correspondence 
between  the  dynamics  that  governs  the  behavior 
of  the  apparatus  and  the  discretely  sampled  time 
series  that  comprises  the  data.  Another  question  is 
how  to  nunirnize  the  effect  of  noise.  In  this  paper, 
we  show  how  the  lime  deLy  embedding  method, 
now  commonly  used  to  reconstruct  an  attractor 
from  experimental  data,  yields  a  novel  procedure 
for  reducing  noise  in  data  whose  dynamics  can  be 
characterized  as  low  dimensional.  Moreover,  we 
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show  how  the  approach  can  be  extended  to  allow 
experimentalisu  access  to  many  of  the  analytical 
tools  mentioned  above. 

Section  2  reviews  the  time  dday  embeddii^ 
method  and  some  of  its  applications.  Section  3 
introduces  some  of  the  problems  associated  with 
traditional  filters  and  outlines  our  noise  reduction 
method. 


2.  The  time  delay  embeddmg  method 

As  stated  in  section  1.  one  problem  in  analyzing 
experimental  data  is  how  to  relate  the  measure¬ 
ments  with  the  dynamics.  Before  the  early  1980's, 
power  spectra  were  the  principal  method  for  ana¬ 
lyzing  such  data.  For  instance.  Fenstermacher 
et  al.  (13]  relied  heavily  on  power  spectra  to  detect 
transitions  from  periodic  to  weakly  turbulent  flow 
between  concentric  rotating  cylinders.  However. 
Fourier  analysis  alone  is  inadequate  for  describing 
the  dynamics. 

Other  methods  also  have  been  used  to  analyze 
time  series  output  from  dynamical  systems.  Lorenz 
(25]  used  next  amplitude  maps  to  describe  some 
features  of  the  dynamics;  that  is.  he  plotted 
against  r„  where  is  the  nth  relative  maximum 
of  the  third  coordinate  of  the  numerically  calcu¬ 
lated  solution.  Such  maps  are  often  useful,  not 
only  for  investigating  features  of  the  Lorenz  at¬ 
tractor  (32).  but  also  for  instance  in  experiments 
on  intermittency  in  oscillating  chemical  reactions 
(30). 

In  the  past  decade,  the  time  delay  embedding 
method  has  come  into  common  use  as  a  way  of 
reconstructing  an  attractor  from  a  time  series  of 
experimental  data.  In  this  approach,  one  supposes 
that  the  dynamical  behavior  is  governed  by  a 
solution  traveling  along  an  attractor^'  (which  is 
not  observable  directly).  However,  one  assumes 
there  is  a  smooth  function  that  maps  points  on 
the  attractor  to  real  numbers  (the  experimental 

‘''Existing  numencal  methods  require  the  attractor  to  be  low 
dimensional 


measurements}.  In  the  embedding  method,  one 
generates  a  set  of  MM&mensional  points  whose 
coordinates  are  values  in  the  time  series  separated 
by  a  constant  dday  (111.  For  example,  when  m  s  3. 
the  reconstructed  attractor  is  the  set  of  points 
=  where  r  is  the  time  dday. 

Takens  {34|  has  shown  that  under  suitable  hy¬ 
potheses.  Jiis  procedure  yidds  a  set  whose  prop¬ 
erties  are  equivalent  to  those  of  the  original 
attraaor  provided  that  the  embedding  dimension 
m  is  large  enough. 

In  principle,  the  embedding  method  allows  one 
to  study  the  dynamics  in  detail.  The  earliest  appli¬ 
cations  may  be  called  static  in  that  the  analysis 
focuses  on  the  geometric  propenies  of  the  set  of 
points  on  the  reconstructed  attractor..  For  exam¬ 
ple.  phase  portraits  and  Poincare  sections  are  used 
in  ref.  [S]  to  hdp  determine  the  transition  between 
quasiperiodic  and  chaotic  flow  in  a  Couette- 
Taylor  experiment.  Another  important  application 
is  the  estimation  of  attractor  dimension  from 
experimental  data,  for  which  there  is  a  large  litera¬ 
ture  (27].  In  addition,  various  .nformation  theo¬ 
retic  notions  can  be  used  to  And  good  choices  of 
embedding  dimension  and  time  delay  [15]. 

More  recent  applications  of  the  embedding 
method  are  quite  different  in  nature  and  can  be 
called  dynamic  in  that  information  about  the  dy¬ 
namics  is  stored  in  the  computer  for  analysis. 
With  each  data  vector  .v,.  one  stores  the  “next” 
vector,  for  example.  for  some  5>0.  This 
makes  it  possible  to  compute  a  linear  approxima¬ 
tion  of  the  dynamics  in  a  neighborhood  of  x,. 
assuming  that  there  is  a  low-dimensional  dynami¬ 
cal  system  underlying  that  data''-.  In  particular,  a 
linear  approximation  provides  an  estimate  of  the 
Jacobian  of  the  map  at  x,  [11].  Eckmann  et  al.  [10] 
use  linear  maps  computed  in  this  way  to  integrate 
a  set  of  variational  equations  and  find  the  positive 
Lyapunov  exponents"’. 

*^This  material  was  first  presented  by  D  Ruelle  at  a  Nobel 
symposium  in  1984 

"'Wolf  et  al.  [37]  have  proposed  a  different  method  in  which 
nearb;  pairs  of  points  are  followed  to  estimate  the  largest 
Lyapunov  exponent 
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In  fact,  the  time  dd^  cmheddine  method  pro¬ 
vides  a  powerful  set  ot  tools  for  analyzing  the 
t^mamics.  the  breadth  of  which  may  not  have 
been  realized  by  Edonann  and  Rudle.  In  the 
remainder  of  tins  paper,  we  discuss  two  novel 
applications  that  ate  possible,  specifically: 

(1)  Noise  nductUm.  Since  one  can  approximate 
the  dynamics  at  each  point,  it  becomes  possible  to 
identify  and  correct  inaccuracies  in  tnyectories 
arising  from  random  errors  in  the  original  time 
series.  Numerical  evidence  suggests  that  the  noise 
reduction  procedure  described  below  improves  the 
accuracy  of  other  analyses,  such  as  Lyapunov 
exponents  and  dimension  calculations. 

(2)  Simplidal  approxinuaions.  Linear  ^tproxi- 
rrutions  can  be  computed  at  each  point  on  a  grid 
in  a  neighborhood  of  the  attractor  'o  form  a 
simplidal  approximation  of  the  dynamical  system. 
This  can  be  used  to  locate  unstable  periodic  orbits 
near  the  attractor.. 

We  consider  noise  reduction  in  section  3.. 


3.  Noise  reduction 

The  ability  to  extract  information  from  time- 
varying  signals  is  limited  by  the  presence  of  noise. 
Recent  experiments  to  study  the  transition  lo  tur¬ 
bulence  in  systems  far  from  equilibrium,  like  those 
by  Fensteimacher  et  al.  [13],  Behringer  and  Ahlers 
[2],  and  Libchaber  et  al.  [24],  succeeded  largely 
because  of  instrumentation  that  enabled  them  to 
quantify  and  reduce  the  noise.  However,  it  is  often 
expensive  and  time  consuming  to  redesign  experi¬ 
mental  apparatus  to  improve  the  signal  to  noise 
ratio. 

An  important  question,  therefore,  is  how  the 
experimental  data  can  be  filtered  or  otherwise 
preprocessed  before  it  is  analyzed  further.  One 
common  approach  is  to  use  Fourier  analysis:  one 
might  model  the  noise  as  a  collection  of  high- 
frequency  components  and  subtract  them  from  a 
power  spectrum  (or  Fourier  transform)  of  the  in¬ 
put  data.  The  transform  can  be  inverted  to  yield  a 


new  lime  senes  with  some  of  the  hi^fiequency 
components  removed.  This  is  the  basic  idea  be¬ 
hind  Wiener  and  other  bandpass  filters  [29]. 

However,  as  noted  previously,  power  spectral 
analysis  is  insuflicient  to  characterize  the  (fynam- 
ics  wiien  the  data  are  diaotic.  Since  the  power 
spectrum  of  a  low-dimensional  diaotic  signal  re¬ 
sembles  that  of  a  noisy  one,  the  suppressicm  of 
certain  frequendes  can  alter  the  dynamics  of  the 
filtered  output  signal  Badii  et  al.  [1]  have  shown 
that  a  simple  low-pass  filter  eifectivdy  introduces 
an  extra  Lyapunov  exponent  that  depends  on  the 
cutoff  frequency'.  If  the  cutoff  frequency  is  suffi- 
dently  low.  then  the  filter  can  increase  the  fractal 
dimension  of  the  reconstructed  attractor.  This  re¬ 
sult  also  has  been  confirmed  by  Mitschke  et  al. 
[28]  with  data  from  an  electronic  drcuit. 

We  now  consider  a  different  approach  and  show 
how  the  time  delay  embedding  method  can  be 
exploited  to  reduce  the  noise,  at  least  in  cases 
where  the  time  series  can  be  viewed  as  a  dynami¬ 
cal  system  with  a  low-dimensional  attractor.  Our 
objective  is  to  use  the  dynamics  to  detect  and 
correct  errors  in  trajectories  that  result  from  noise. 
This  is  done  in  two  steps  once  an  embedding 
dimension  m  and  a  time  delay  t  have  been  fixed. 

In  the  first  step,  we  consider  the  motion  of  an 
ensemble  of  points  in  a  small  neighborhood  of 
each  point  on  the  attractor  in  order  to  compute  a 
linear  approximation  of  the  dynamics  there.  In  the 
second  step,  we  use  these  approximations  to  con¬ 
sider  how  well  an  individual  trajectory  obeys  them. 
That  is,  we  ask  how  the  observed  trajectory  can  be 
perturbed  slightly  to  yield  a  new  trajectory  that 
satisfies  the  linear  maps  better.  The  trajectory 
adjustment  is  done  in  such  a  way  that  a  new  time 
series  is  output  whose  dynamics  are  more  consis¬ 
tent  with  those  on  the  phase  space  attractor. 

This  approach  is  fundamentally  different  from 
traditional  noise  reduction  methods.  Because  we 
consider  the  motion  of  points  on  a  phase  space 
attractor,  we  are  using  information  in  the  original 
signal  that  is  not  localized  in  a  time  or  frequency 
domain.  Points  that  are  close  in  phase  space  corre¬ 
spond  to  data  that  in  general  are  widely  and 
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iir^ulariy  spaced  in  time,  due  to  the  sensitive 
dqxndeice  on  initial  conditkms  on  chaotic  at¬ 
tractors.  In  contrast.  Kalman  {4)  and  similar  filters 
examine  data  that  ate  closely  spaced  in  time: 
bandpass  filters  operate  in  the  frequency  domain. 


4.  Fxhmaiui-RueHe  lineariratioo 

The  discrete  sampling  of  the  original  signal 
means  that  the  points  on  the  reconstructed  attrac¬ 
tor  can  be  treated  as  iterates  of  a  nonlinear  map  / 
whose  exact  form  is  unknown.  We  assume  that  / 
is  nearly  linear  in  a  small  neighborhood  of  each 
attractor  point  x  and  write 

/(x)  =  /1x  +  63L(-) 

for  some  mxm  matrix  A  and  m-vector  b.  (The 
matrix  A  is  the  Jacobian  of  /  at  x.) 

This  approximation,  which  we  call  the  Eck- 
mann-Ruelle  linearization  at  x,  can  be  computed 
with  least-squares  methods  similar  to  those  de¬ 
scribed  in  refs.  [11,  10).  Given  a  reference  point 
x„,,  let  {x, be  a  collection  of  the  n  points 
which  are  closest  to  x„,.  With  each  point  x,  we 
store  the  next  point  (i.e.,  the  image  of  x,),  denoted 
The  klh  row  a^  of  A  and  the  /cth  compo¬ 
nent  of  b  are  given  by  the  least-squares  solu¬ 
tion  of  the  equation 

.Vt  =  ^ +  (1) 

where  v*  is  the  k  th  component  of  and  the  dot 
denotes  the  dot  product.  Fig.  1  illustrates  the 
idea*^. 

“*Thc  points  X,  are  points  on  the  attractor  which  are  noi 
consecutive  m  time.  The  subscnpt  i  merely  enumerates  all  the 
points  on  the  attractor  contained  within  a  small  distance  c  of 
x,c,.  In  this  notation,  x,  and  y,  are  consecutive  in  time. 

“’Farmer  and  Sidorowich  [12]  observe  that  the  Eckmann- 
Ruelle  hneanzation  can  be  used  for  prediction  Given  a  refer¬ 
ence  point  X,,  find  the  Eckmann-Ruelle  hneanzation  /4,x  + 
compute  X,.,  =A,x,  +  b,.  and  repeat  the  process  to  get  the 
predicted  trajectory 


Fig.  1.  Schematic  diagram  for  the  first  stage  of  the  noise 
reduction  method.  A  collection  of  points  in  an  c-ball  about  the 
refetence  point  x,^  is  used  to  find  a  linear  approximation  of 
the  dynamics  there. 

We  mention  three  difficulties  in  computing  the 
local  linear  approximations  in  the  subsections  be¬ 
low. 

4.1.  Ill  conditioned  least  squares 

There  is  a  particular  problem  when  one  tries  to 
compute  solutions  to  eq.  (1)  with  a  finite  data  set 
of  limited  accuracy  that  has  not  been  addressed  in 
previous  papers  (10,  31].  Suppose  for  example  that 
all  the  points  in  a  neighborhood  of  x„,  lie  nearly 
along  a  single  line.  i.e..  the  attractor  appears  one 
dimensional  within  the  available  resolution.  Al¬ 
though  it  is  possible  to  measure  the  expansion 
along  the  unstable  manifold  at  x„,,  there  are  not 
enough  points  in  other  directions  to  measure  the 
contraction.  Hence  it  is  not  possible  to  compute  a 
2x2  Jacobian  matrix  accurately.  Any  attempt  to 
do  so  will  result  in  an  estimate  of  the  Jacobian 
whose  elements  have  large  relative  errors.  This 
kind  of  least-squares  problem  is  ill  conditioned. 

The  ill  conditioning  can  be  avoided  by  changing 
coordinates  so  that  the  first  vector  in  the  new  basis 
points  in  the  unstable  direction**.  A  one-dimen¬ 
sional  approximation  of  the  dynamics  is  com¬ 
puted  using  the  new  coordinates;  that  is,  we 
approximate  the  dynamics  only  along  the  unstable 
manifold.  We  recover  the  matrix  A  by  changing 
coordinates  back  to  the  onginal  basis. 

For  example,  if  we  are  working  in  the  plane  and 
the  unstable  direction  is  the  line  y  =  x,  then  we 
rotate  the  coordinate  axes  by  45°,  The  dynamics 
are  approximated  by  a  one-dimensional  linear  map 

“*This  IS  done  by  computing  the  nght  singular  vectors  [9]  of 
the  n  X  m  matrix  whose  j  th  row  is  x^  The  procedure  is  called 
principal  component  anaivsis  in  the  statistical  hterature. 
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computed  along  the  line  y  =  x.  Then  we  rotate 
back  to  the  original  coordinates.  (The  resulting 
matrix  A  has  rank  1  in  this  example.)  This  ap¬ 
proach  substantially  enhances  the  robustness  of 
the  numerical  procedure. 

4.2.  Finding  nearest  neighbors 

A  second  problem  is  finding  an  efficient  way  to 
locate  all  of  the  points  closest  to  a  given  reference 
point.  The  dynamical  embedding  method  impo.ses 
stringent  requirements  on  any  nearest-neighbor 
algorithm.  The  storage  overhead  for  the  corre¬ 
sponding  data  structures  must  be  small,  because 
there  are  tens  of  thousands  of  attractor  points. 
The  algorithm  must  be  fast,  since  there  is  one 
nearest-neighbor  problem  for  each  linear  map  to 
be  computed. 

We  solve  this  problem  by  partitioning  the  phase 
space  into  a  grid  of  boxes  that  is  parallel  to  the 
coordinate  axes.  Each  coordinate  axis  is  divided 
into  B  intervals.  (Fig.  2  illustrates  the  gnd  in  two 
dimensions.)  Each  point  on  the  attractor  is  as¬ 
signed  a  box  number  according  to  its  coordinates. 
For  example,  a  point  on  the  plane  whose  first 
coordinate  falls  in  the  yth  interval  (counting  from 
0)  along  the  .x  axis  and  whose  second  coordinate 
falls  in  the  ^  th  interval  along  the  y  axis  is  as¬ 
signed  to  box  number  kB  +  j.  The  list  of  box 
numbers  is  sorted,  carrying  along  a  pointer  to  the 
original  data  point.  Given  a  reference  point 
its  box  number  is  found  using  the  above  formula. 
A  binary  search  in  the  list  of  box  numbers  then 
locates  the  address  of  and  all  the  other  points 


B^-B 

■ 

B 

■ 
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0 
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Fig.  2.  Box  numbenng  scheme  in  two  dimensions.  The  attrac¬ 
tor  is  normalized  to  fit  in  the  umt  square.  The  bottom  row  of 
boxes  rests  against  the  x  axis  and  the  leftmost  row  of  boxes 
against  the  v  axis. 


in  the  same  box  number.  The  search  is  extended  if 
necessary  to  adjacent  boxes. 

Only  a  crude  partition  is  needed  for  this  algo¬ 
rithm  to  work  efficiently  (typically  we  choose  B  = 
40).  and  the  grid  is  extended  only  to  the  first  three 
coordinate  axes,  v 'hen  the  embedding  dimension 
is  larger  than  three,  a  preliminary  list  of  nearest 
neighbors  is  obtained  using  only  the  first  three 
coordinates  of  each  attractor  point.  The  final  list  is 
extracted  by  computing  the  distances  from  x„f  to 
each  point  in  the  preliminary  list. 

Although  there  are  circumstances  where  this 
algorithm  can  perform  poorly  (e.g..  when  most  of 
the  attractor  points  are  concentrated  in  a  handful 
of  boxes),  the  distnbution  of  points  on  typical 
attractors  is  sufficiently  uniform  that  the  running 
time  is  very  fast.  Memory  use  is  also  efficient:  a 
set  of  N  attracto.  points  requires  3N  storage  loca¬ 
tions.  In  contrast,  the  tree-search  algorithm  ad¬ 
vocated  in  ref.  [12]  requires  several  limes  more 
storage  (although  the  lookup  time  is  probably 
slightly  less).  Because  A/  ®  10^  in  typical  applica¬ 
tions.  we  believe  that  the  box-grid  approach  (or 
some  variant)  is  the  most  practical.  A  survey  of 
other  nearest-neighbor  algonthms  is  given  in  ref. 

[3]. 

4.3.  Errors  in  variables 

There  is  a  potential  difficulty  in  the  use  of 
ordinary  least  squares  to  compute  the  linear  maps. 
In  the  usual  statistical  problem  of  fitting  a  straight 
line,  one  has  observations  (.v,.  y,)  where  .r,  is 
known  exactly  and  y,  is  measured.  One  assumes 
that  y,  =  aQ  +  ayX,  +  e,.  w’lere  the  t,  are  indepen¬ 
dent  errors  drawn  from  the  same  normal  distri¬ 
bution.  (Analogous  assumptions  hold  in  the 
multivariate  case.)  In  the  present  situation,  how¬ 
ever,  both  .V,  and  y,  are  measured  with  error.  It 
can  be  shown  that  the  ordinary  least-squares 
method  produces  biased  estimates  of  the  parame¬ 
ters  ag  ai  in  this  case  [16.  23).  In  practice  this 
does  not  seem  to  be  a  serious  problem,  but  statis¬ 
tical  procedures  to  handle  this  situation  (the  so- 
called  “errors  in  variables”  methods)  may  provide 
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Fig.  3.  Schematic  diagram  of  the  trajectory  adjustment  proce¬ 
dure.  The  trajectory  defined  by  the  .sequence  ( x, }  is  perturbed 
to  a  new  trajectory  given  by  { x, }  which  is  more  consistent  with 
the  dynamics.  In  this  example  we  show  what  the  perturbed 
trajectory  might  look  hkr  ;f  the  dynaimcs  were  approximately 
horizontal  translation  to  the  nght. 

an  alternative  approach  to  noise  reduction.  We 
consider  this  question  in  the  appendix. 


5.  Trajectory  adjustment  by  rn-nimizing 
self'inconsistency 

The  Eckmann-Ruelle  linearization  procednri* 
described  above  is  computed  and  the  resulting 
maps  are  stored  for  a  sequence  of  reference  points 
along  a  given  trajectory  (for  the  results  quoted 
here,  the  sequence  usually  contains  24  points).  We 
now  consider  how  to  perturb  this  trajectory  so 
that  it  is  more  consistent  with  the  dynamics.  The 
objective  is  to  choose  a  new  sequence  of  points  x, 
to  minimize  the  sum  of  squares 

+  11-',-  +  -  L,{x,)\\\  (2) 

where  L{x,)  =  A,x,  +  b,,  w  is  a  weighting  factor, 
and  the  sum  runs  over  all  the  points  along  the 
trajectory*’.  Eq.  (2)  can  be  solved  using  least 
squares.  Heuristically,  eq.  (2)  measures  the  self¬ 
inconsistency  of  the  data,  assuming  that  the  linear 
approximations  of  the  dynamics  are  accurate.  See 
fig.  3.  We  say  the  new  sequence  {x, }  is  more 
self-consistent. 

*’ln  the  results  descnbed  in  this  paper,  the  Eckmann-Ruelle 
lir.earization  procedure  is  done  using  a  collection  of  points 
within  a  radius  of  1-6%  of  each  r.ference  point,  depending  on 
the  embedding  dimension,  the  dimension  of  the  attractor,  and 
the  nutnbtr  of  attractor  points.  This  results  in  collecuons  of 
SO-200  points  per  ball,  which  gives  reasonably  accurate  map 
approximations  without  making  the  computer  program  too 
slow.  The  weighting  factor  w  is  set  to  1. 


The  trajectory  adjustment  can  be  iterated.  That 
is,  once  a  new  trajectory  x,  has  been  found,  one 
can  replace  each  x,  in  eq.  (2)  by  x,  and  compute  a 
new  sequence  (x,}. 

We  place  an  upper  limit  on  the  distance  a  point 
can  move.  Points  which  seem  to  require  especially 
large  adjustments  can  be  flagged  and  output  un¬ 
changed.  (This  may  be  necessary  if  the  input  time 
senes  contains  large  “glitches”  or  if  nonhnearities 
are  significant  over  small  distances  in  certain  re¬ 
gions  of  the  attractor.) 

When  the  input  is  a  time  senes,  we  modify  the 
above  procedure  slightly  since  we  require  a  time 
series  as  output.  The  trajectory  adjustment  is  done 
so  that  changes  to  the  coordinates  of  x,  (corre¬ 
sponding  to  particular  time  senes  values)  are  made 
consistently  for  all  subsequent  points  whose  co¬ 
ordinates  are  the  same  time  series  values.  For 
example,  suppose  the  time  delay  is  1  and  the 
embedding  dimension  is  2.  Then  trajectories  are 
perturbed  so  that  the  second  coordinate  of  the  i  th 
point  IS  the  same  as  the  first  coordinate  of  the 
(/-l-l)st  point.  That  is,  when  x,  =  (s,,s,  +  i)  is 
moved  to  the  point  x,  =  (f,,  1,  +  ,),  we  require  that 
the  first  coordinate  of  x,,. ,  be  s, , ,. 

6.  Results  using  experimental  data 

We  note  that  the  attractor  need  not  be  chaotic 
for  this  noise  reduction  procedure  to  be  effective. 
Fig.  4a  shows  a  phase  portrait  of  noisy  measure¬ 
ments  of  wavy  vortex  flow  in  a  Couette-Taylor 
experiment  [20).  This  flow  is  periodic,  so  the  at¬ 
tractor  is  a  limit  cycle  (widened  into  a  band  be¬ 
cause  of  the  noise)  and  the  power  spectrum 
consists  of  one  fundamental  frequency  and  its 
harmonics  above  a  noise  floor.  See  fig.  4b.  Figs. 
4c,  4d  show  the  same  data  after  noise  reduction. 
The  noise  reduction  procedure  makes  the  limit 
cycle  much  narrower,  and  the  noise  floor  in  the 
power  spectrum  is  reduced  by  almost  two  orders 
of  magnitude.  However,  no  power  is  subtracted 
from  any  of  the  fundamental  frequencies,  and  in 
fact  some  harmonics  are  revealed  which  previously 
were  obscured  by  the  noise. 
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Fig  4  Phase  portraits  and  power  spectra  for  measurements  of  wavy  vortex  flow  m  a  Couette-Taylor  experiment,  (u).  (bj  Phase 
portrait  and  power  spectrum  before  noise  reduction  is  applied:  (c),  (d)  after  noise  reduction:  (e),  (f)  after  a  low-pass  Alter  is  applied 
to  the  onginal  data  The  vertical  axis  in  (b).  (d)  and  (f)  is  the  base-10  logarithm  of  the  power  spectral  density,  the  honzontal  axis  is  in 
multiples  of  the  Nyquist  frequency. 


These  results  are  significantly  different  from 
those  obtained  by  low<pass  filtering.  Figs.  4e,  4f 
show  the  phase  portrait  and  power  spectrum  when 
the  original  data  are  passed  through  a  12th-order 
Butterworth  filter  with  a  cutoff  frequency  of  0.35. 
The  dynamical  noise  reduction  procedure  is  more 


effective  than  low-pass  filtering  since  the  noise 
appears  to  have  a  broad  spectrum. 

However,  the  dynamical  noise  reduction  method 
appears  to  subtract  power  from  a  mode  whose 
fundamental  frequency  is  approximately  0.3  times 
the  Nyquist  frequency.  We  do  not  know  exactly 
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Fig  5  PhaiC  portraits  and  power  spectra  for  measurements  of  weaklv  chaotic  (low  m  a  Couctte-Taylor  experiment  (a),  (b)  Phase 
portrait  and  power  spectrum  before  noise  reduction  is  applied,  (c),  (d)  after  noise  reduction  The  units  for  the  power  spectrum  plots 
arc  the  same  as  those  in  ref.  (5| 


why  this  occurs.  However,  this  peak  corresponds 
to  the  rotation  frequency  of  the  inner  cylinder  and 
may  result  from  a  defect  in  the  Couette-Taylor 
apparatus  (33].  We  do  not  consider  this  to  be  a 
serious  problem,  because  the  power  associated  with 
this  mode  is  several  orders  of  magnitude  smaller 
than  that  of  the  wavy  vortex  flow. 

We  emphasize  that  our  objective  is  to  find  a 
simple  dynamical  system  that  is  consistent  with 
the  data.  It  is  possible  for  this  method  to  elim>nate 
certain  dynamical  behavior  from  an  attractor  if 
those  dynamics  have  very  small  amplitude,  as  fig. 
4f  shows.  This  situation  is  most  likely  to  arise 
when  there  are  not  enough  data  to  distinguish 
such  dynarmes  from  random  noise.  In  the  present 


example,  the  noise  reduction  procedure  reveals  the 
limit  cycle  behavior  quite  well®'*. 

The  results  obtained  by  applying  the  method  to 
chaotic  data  from  the  Couette-Taylor  fluid  flow 
experiment  described  in  ref.  (5)  are  shown  in  fig.  5. 
Fig.  5a  shows  a  two-dimensional  phase  portrait  of 
the  raw  time  series  at  a  Reynolds  number  R/R^  = 
12.9,  which  corresponds  to  weakly  chaotic  flow  [5], 
The  corresponding  phase  portrait  from  the  filtered 
time  series  is  shown  in  fig.  5b.  Figs.  5c.  5d  show 

“"We  have  not  attempted  to  find  the  smallest  amphtude  at 
which  the  noise  reduction  procedure  can  distinguish  quasipen- 
odic  from  penodic  how  In  general  this  will  depend  on  the 
amount  of  data,  the  sampling  rate,  the  embedding  dimension, 
and  other  factors. 
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the  power  spectra  for  the  cot  responding  time 
senes  . 

It  is  difficult  to  estimate  how  much  noise  is 
removed  from  the  data  in  this  example  on  the 
basis  of  power  spectra.  One  problem  is  that  the 
transition  from  quasiperiodic  to  weakly  chaotic 
fluid  flow  is  mark'td  by  a  sudden  rise  in  the  noise 
floor  in  the  power  spectrum  (cf.  fig.  3  in  ref.  [5]). 
Hence  one  car  not  determine  how  much  of  the 
noise  floor  is  cue  to  deterministic  chaos  and  how 
much  results  from  broad-band  noise.  The  noise 
reduction  procedure  described  here  has  the  etfect 
of  reducing  the  power  in  the  high-frequency  com¬ 
ponents  of  the  signal.  One  question  therefore  is 
whether  reducing  the  high-frequency  noise  corre¬ 
sponds  to  discovering  the  true  dynamics  which 
have  been  masked  by  noise.  We  believe  that  the 
answer  is  yes,  based  on  those  cases  where  there  is 
an  underlying  low-dimensional  dynamical  system. 
However,  in  chaotic  processes  some  high-frequency 
components  remain,  because  they  are  appropriate 
to  the  dynamics. 

7.  Numerical  experiments  on  noise  reduction 

One  important  question  is  how  much  noise  this 
method  removes  from  the  data.  The  power  spectra 
above  suggest  that  the  method  eliminates  most  of 
the  noise,  but  it  is  impossible  to  give  a  precise 
estimate  for  typical  chaotic  experimental  data. 

However,  the  Henon  map  (19)  provides  a  conve¬ 
nient  way  to  quantify  the  noise  reduction,  because 
it  can  be  written  as  a  time  delay  map  of  the  form 

=/{x„x,^i)  =  1  (3) 

We  use  eq.  (3)  to  generate  a  time  series  as  follows 
(with  the  standard  parameter  values  a  =  1.4,  p  = 
0.3).  We  choose  an  initial  condition  and  discard 
the  first  100  iterates.  Tlie  next  32768  iterates  are 

*'*The  time  senes  consists  of  32  768  values,  from  which  an 
attractor  is  reconstructed  in  four  dimensions  Linear  maps  are 
computed  using  SO- 100  points  m  each  ball  Trajectones  are 
fitted  using  sequences  of  24  points. 


Stored,  and  a  time  series  is  generated  by  adding  a 
umformly  distributed  random  number  to  each  it¬ 
erate.  This  simulates  a  time  series  with  measure¬ 
ment  noise,  i.e.,  a  time  senes  where  noise  results 
from  errors  in  measuring  the  signal,  not  from 
perturbations  of  the  dynamics. 

We  measure  the  improvement  in  the  signal  after 
processing  by  considering  the  pointwise  error 

i.e.,  the  distance  between  the  observed  image  and 
the  predicted  one.  Let  the  mean  error  be 


the  rms  value  of  the  pointwise  error  over  all  N 
points  on  the  attractor.  We  define  the  noise  reduc¬ 
tion  as 

^  ~  ^  ~  ^filled/ ^noiiv ' 

where  the  mean  errors  are  computed  for  the  ad¬ 
justed  and  original  noisy  time  series,  respectively. 
The  quantity  /?  is  a  measure  of  the  self-con¬ 
sistency  of  the  time  senes.  (In  other  words.  R 
measures  how  much  better  on  the  average  the 
output  attractor  obeys  eq.  (3)  as  one  hops  from 
point  to  point.) 

When  1%  noise  is  added  to  the  input  as  de¬ 
scribed  above,  the  noise  reduction  (measured  with 
the  actual  map)  is  79%"*'^.  Nearly  identical  resu,ts 
are  obtained  when  the  input  contains  only  0.1% 
noise.  In  addition,  noise  levels  can  be  reduced 
almost  as  much  in  cases  where  the  noise  is  added 
to  the  dynamics,  i.e..  where  the  input  is  of  the 
form  {.x,,i :  .V,,,  =/(.x,  +  7)„  x,_, -(-T?,.i).  ij,. 
T),.i  random}.  When  the  program  is  run  on  noise¬ 
less  input,  the  mean  error  in  the  output  is  0.025% 
of  the  attractor  extent,  which  suggests  that  errors 

“'“The  pointwise  error  is  measured  using  eq  (3)  However, 
the  attractor  can  be  embedded  in  more  than  two  dimensions 
when  performing  the  noise  reduction 
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ansing  from  small  nonlineariiies  are  negligible 
when  the  input  contains  enough  points. 

8.  Simplicial  approximations  of  dynamical  systems 

Recent  work  has  shown  that  simplicial  approxi¬ 
mations  of  dynamical  systems  can  reproduce  the 
behavior  of  the  original  system  to  high  accuracy 
(36).  (See  also  ref.  [35)  for  a  bilineai  approach.)  In 
particular,  the  fractal  structure  of  the  original 
attractors  and  basin  boundaries  is  preserved  over 
many  scales.  Such  approximations  can  yield  sig¬ 
nificant  computational  savings,  especially  when 
the  original  system  consists  of  ordinary  differential 
equations. 

This  approach  can  be  extended  in  a  natural  way 
to  generate  simplicial  app;  oximations  of  the  dy¬ 
namics  on  attractors  recon,structed  from  experi¬ 
mental  data.  Our  objective  here  is  to  find  an 
approximate  dynamical  system  in  a  neighborhood 
of  the  attractor  as  follows. 

A  simplex  in  an  m-dimensional  space  is  a  trian¬ 
gle  with  m  +  I  vertices.  Suppose  the  map  is  known 
at  each  point  on  a  grid.  Then  there  is  a  unique 
way  to  extend  the  map  linearly  to  the  interior  of 
the  simplex  S  whose  vertices  are  grid  points. 
Given  a  point  P  in  the  interior  of  5,  let  {/>,  )™o 
be  its  corresponding  baryceninc  coordinates  (see 
ref.  [36]  for  an  algorithm  to  compute  them).  Let 
/(u,)  be  the  map  at  the  ith  vertex.  The  dynamical 
system  at  P  i'  '•ated  by  compiuing 

OI 

1-0 

We  apply  this  method  to  experimental  data  by 
finding  a  linear  approximation  of  the  dynanucs  at 
each  vertex  v,  with  the  least-squares  method  de- 
sc'  -‘d  above.  ;sing  a  collection  of  points  in  a 
SI  il  ball  around  ti,.  The  maps  are  stored  and 
retrieved  using  a  hashing  algorithm  similar  to  that 
described  in  ref.  [36].  This  yields  a  piecewise  linear 
approximation  of  the  dynamics  from  a  set  of 
experimental  data  which  can  be  analyzed  with  the 


methods  that  previously  were  available  only  to 
theorists 

We  illustrate  the  approach  using  a  time  series  of 
32768  values  from  the  Henon  map  with  a  =  1.2. 
/J  =  0.3  using  eq.  (3)  and  adding  0.1%  noise  as 
described  above.  The  original  attractor  is  shown  in 
fig.  6a.  We  t.ike  a  grid  of  points  which  aie  spaced 
at  1%  intervals  (this  and  subsequent  distances  are 
expressed  as  a  fraction  of  the  original  attractor 
extent).  The  time  series  is  embedded  in  wo  di¬ 
mensions.  and  a  linear  approximation  of  the  dy¬ 
namics  is  computed  at  each  grid  point  for  which 
50  or  more  attractor  points  can  be  collected  with  a 
ball  of  radius  0.03:  the  set  of  such  grid  points  is 
shown  in  fig.  6b.  We  take  an  initial  condition  near 
the  original  attractor  and  show  the  first  3000  iter¬ 
ates  using  eq.  (4)  in  fig.  6c.  Although  some  defects 
are  visible,  the  attractor  produced  by  the  approxi¬ 
mate  dynamical  system  looks  almost  identical  to 
the  original  one. 

One  application  of  simplicial  approximations  is 
the  location  of  periodic  saddles  and  the  estimation 
of  the  largest  eigenvalue  of  the  corresponding 
Jacobian.  That  is.  if  x  is  a  periodic  point  of  period 
p.  then  we  find  the  eigenvalue  of  Dflx)  of 
largest  modulus,  where  Df'ix)  refers  to  the  ma¬ 
trix  of  partial  derivatives  of  the  p\h  iterate  of  the 
map  /  evaluated  at  .v. 

Gii'en  an  initial  guess  for  .v.  one  can  apply 
Newton's  method  using  the  maps  computed  at  the 
grid  points  and  eq.  (4)  to  locate  the  saddle  using 
the  simplicial  approximations.  Likewise,  eq.  (3) 
can  be  used  to  locate  the  corresponding  “exact” 
saddle.  Saddle  orbits  up  to  period  8  have  been 
computed  in  this  way.  In  all  cases,  the  saddle 
point  for  the  simplicial  approximation  is  within 
2%  of  the  corresponding  saddle  point  for  the 
Henon  map.  Table  1  shows  the  largest  eigenvalues 
of  the  saddle  orbits.  (The  columns  labeled  m  =  2 
and  m  =  3  refer  to  the  embedding  dimension  used 
to  reconstruct  the  attractor.)  In  most  cases,  the 

“"This  approach  is  less  ambitious  than  that  of  Crutchfield 
{8),  who  attempts  to  find  a  single  set  of  nonlinear  difference 
equations  that  creates  the  observed  attractor 
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relative  error  is  only  a  few  percent,  and  in  no  case 
exceeds  25%.  (The  largest  relative  error  is  for  the 
period  8  saddles,  where  one  finds  the  eigenvalue  of 
the  product  of  8  Jacobians  computed  from  the 
least  squares.) 

■'his  method  can  be  extended  to  experimental 
d  itu  sets.  However,  there  are  relatively  stringent 

.lUiremtmts  on  the  data  th’it  can  be  handled:  the 
time  se/ies  must  be  long  en  -lugh  to  trace  out  many 
trajectories  near  the  princtpal  unstable  saddle  or¬ 
bits,  and  the  noise  level  must  be  low.  (Presumably, 
n  oisy  data  can  be  preprocessed  using  the  approach 


Fig.  6.  (a)  Henon  attractor  computed  from  eq.  (3)  with  a  =  1  2. 
/}  =  (!}  (b)  11  grid  on  which  linear  approximations  of  the 
dynamics  are  computed  from  the  available  attractor  points,  (c) 
Attractor  produced  by  the  simplicial  approximauons 

described  in  section  4.)  The  current  computer  im¬ 
plementation  uses  a  large  amount  of  disk  space  to 
store  the  linear  map  approximations  at  the  grid 
points. 

We  have  constructed  a  simplicial  approximation 
for  an  attractor  obtained  from  a  Belousov- 
Zhabotinskii  chemical  reaction  (7,  30].  The  attrac¬ 
tor  is  reconstructed  in  three  dimensions  from  a  set 
of  32  768  measurements  of  bromide  ion  concentra¬ 
tion.  The  phase  portrait  is  shown  in  hg.  7a. 

Linear  approximations  of  the  dynamics  are 
computed  at  each  point  of  a  grid  consisting  of  SO 
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Table  1 

The  largest  eigenvalues  of  the  Jacobian  of  the  penodic  orbits 
located  using  the  simplicial  approximation  of  the  Henon 
attractor. 


Period 

m  ■*  2 

Exact 

m-3 

1 

1.793 

1.695 

1.757 

2 

2.178 

2.199 

2.183 

4 

4.226 

4.329 

4  051 

6 

10.38 

10.70 

9.626 

6 

10.38 

11.32 

1212 

K 

2S.80 

24.88 

30.25 

S 

20.02 

20.60 

20.38 

x 

17.70 

24.32 

21.70 

the  attractor.  Using  initial  guesses  from  some  of 
the  trajectories,  we  apply  Newton’s  method  to 
locate  the  saddle  orbit  shown  in  fig.  7b.  Moreover, 
we  obtain  estimates  of  the  Jacobian  D/  of  the  map 
evaluated  at  a  point  on  the  saddle  orbit.  The 
eigenvalues  of  D/  are  estimated  as  1.14. 
Xj- 0.102.  and  X3=-1.53.  These  quantitative 
results  confirm  that  the  orbit  is  a  saddle  since  Xj  > 
0  >  Xj.  (Note  that  one  expects  Xj  =  0  for  a  flow 
generated  from  a  set  of  diffeiential  equations.) 

9.  Conclusion 


intervals  along  each  coordinate  axis  for  which  50 
or  more  attractor  points  can  be  located  within  an 
8%  radius  of  the  grid  point.  This  produces  a 
.  database  of  59  550  maps.  We  observe  from  graphi¬ 
cal  evidence  that  many  traje.  tories  approach  what 
appears  to  be  a  period-3  saddle  in  the  ntiddle  of 


Fig  7.  (a)  The  attractor  reconstructed  from  a  time  senes  of 
bromide  ion  concentrauons  m  a  Belousov-Zbabotinsku  chemi¬ 
cal  reacuon.  (b)  The  penod-3  saddle  orbit 


Methods  for  approximating  the  dynamics  of 
attractors  reconstructed  from  experimental  data 
provide  powerful  tools.  Most  of  the  same  proce¬ 
dures  that  have  been  so  important  for  theoretical 
insight,  such  as  Poincar^  maps,  unstable  fixed 
points  and  their  manifolds,  basin  boundaries,  and 
the  like,  are  now  available  to  experimenters,  at 
least  in  cases  where  the  dynamics  are  low  dimen¬ 
sional.  There  is  little  doubt  that  these  tools  will 
lead  to  breakthroughs  in  the  understanding  of  a 
wide  variety  of  physical  systems.  However,  consid¬ 
erable  effort  is  needed  before  we  learn  which  kinds 
of  systems  will  benefit  most  from  these  types  of 
analyses.  Significant  improvements  in  technique 
will  certainly  extend  the  applicability  of  dynami¬ 
cal  embedding  methods,  for  example  to  higher¬ 
dimensional  attractors. 


Appendix 

In  this  appendix  we  outline  a  possible  alterna¬ 
tive  noise  reduction  method  based  on  the  theory 
of  least  squares  when  all  the  quantities  in  the 
regression  are  measured  with  error. 

In  ordinary  least  squares,  the  variables  in  the 
problem  fall  into  two  classes:  the  independent 
variables,  which  are  known  exactly,  and  the  de¬ 
pendent  variables,  which  are  observations  assumed 
to  be  functions  of  the  independent  variables.  The 
dependent  variables  are  subject  to  random  errors 
that  are  assumed  independent  and  identically  dis¬ 
tributed  (i.i.d.). 
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On  an  attractor  reconstructed  from  experimen¬ 
tal  data,  we  assume  that  the  mapping  which  takes 
points  in  a  sufficiently  small  *'  'i  to  their  images  is 
approximately  linear.  Howevci.  the  locations  of  all 
the  points  are  subject  to  small  random  errors 
because  of  the  noise.  Hence  one  cannot  describe 
the  points  as  independent  variables  and  their  im¬ 
ages  as  dependent  variables.  The  usual  least- 
squares  method  produces  a  biased  estimate  of  the 
linear  map.  and  this  bias  does  not  decrease  if  more 
observations  are  added  (16.  23). 

The  so-called  “errors  in  variables’*  least-squares 
methods  can  be  used  to  handle  the  latter  problem. 
This  approach  can  be  used  to  obtain  both  an 
estimate  of  the  linear  map  as  well  as  estimates  of 
the  “  true"  values  of  each  of  the  observations. 

At  first  this  appears  to  be  an  underdetermined 
problem;  from  n  pairs  of  observations  one  wants 
to  compute  the  parameters  of  the  functional  rela¬ 
tion  between  them  as  well  as  estimates  of  the  n 
actual  pairs’*^.  However,  it  is  possible  to  solve 
this  problem  by  making  some  assumptions  about 
the  errors  (16,  23). 

In  our  case,  we  assume  that  the  errors  in  the 
location  of  each  point  and  its  image  are  i.i.d.  in 
particular,  we  let  the  cuvanance  matrix  of  the 
errors  in  the  variables  be  the  identity  matrix.  This 
assumption  is  valid  whenever  the  noise  is  indepen¬ 
dent  of  the  dynamics*'^ 

We  illustrate  the  procedure  for  the  case  where 
we  are  given  a  collection  of  n  points  (in  R”*)  and 
their  images.  Following  Jefferys  (21).  we  form  a  set 
of  n  equations  of  condition  given  by 

/i  I  •*^1 )  “  •'^11  -  I  ~  =  (5) 

where  x,  is  the  Jth  point.  x„^,  is  its  observed 
image,  .4  is  an  m  x  m  matrix,  and  b  is  an  w-vec- 
tor.  The  goal  is  to  find  estimates  of  L  (i.e,.  A  and 

“'In  the  siausucai  bteratuie.  the  problem  is  said  to  be 
midenufied 

^'^Dynapucal  noise  (i.e..  each  point  is  perturbed  shghtly 
before  iteraun^.'  yields  a  covariance  matru  which  depends  on 
the  point  However,  as  long  as  the  dynamical  noise  is  small, 
our  assumpuons  about  the  covariance  matrix  of  the  errors 
should  not  compromise  the  accuracy  of  the  method. 


b).  together  with  perturbations  6.  such  that 

and  such  that  the  quadratic  form 

5o»  (6) 

is  minimized.  The  superscript  t  denotes  transpose 
and  o  is  the  covariance  matrix  of  the  observations 
(which  we  assume  is  the  identity  matrix  here). 

This  minimization  problem  can  be  solved  using 
Lagrange  multipliers  (see  refs.  (21,  22)  for  a  nu¬ 
merical  algorithm).  The  solution  gives  A  and  b 
together  with  estimates  x,  -i-  6,  of  the  "  true”  ob¬ 
servations.  It  can  be  shown  (16)  under  fairly  ntild 
hypotheses  that  the  estimates  of  L  and  the  obser¬ 
vations  are  the  best  in  the  class  of  linear  estima¬ 
tors. 

One  way  to  approach  noise  reduction  is  to 
extend  eq.  (S)  to  include  several  iterations  of  the 
observed  points.  Given  a  collection  of  points  in  a 
ball,  together  with  the  next  p  iterates  of  each 
point,  the  method  above  is  used  to  find  a  collec¬ 
tion  of  linear  maps  t,,  Lj . approximating 

the  dynamics.  The  method  also  finds  estimates 
of  the  actual  observations.  In  this  approach, 
therefore,  the  calculation  of  the  maps  and  the 
adjustment  of  the  trajectories  is  done  in  one  step. 
Moreover,  each  point  and  its  image  exactly  satisfy 
a  linear  relationship. 

Of  course,  p  cannot  be  too  large,  because 
nonlinear  effects  eventually  will  become  significant 
when  the  dynamics  are  chaotic.  On  the  other 
hand,  eq.  (S)  provides  a  natural  way  to  include 
quadratic  or  other  nonlinear  terms. 

We  have  written  a  computer  program  to  imple¬ 
ment  this  alternative  noise  reduction  algorithm.  So' 
far,  the  results  of  this  approach  have  not  been  as 
good  as  those  from  the  method  described  in  the 
main  part  of  the  paper,  but  further  refinement 
should  improve  them. 
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ANTIMONOTONICITY:  CONCURRENT  CREATION 
AND  ANNIHILATION  OF  PERIODIC  ORBITS 

I.  K,\N  AND  J.  A.  YORKE 


ABSTRACT.  One-parameter  tamilics  t-  of  diffeomorphisms  of 
ihe  Euclidean  plane  arc  known  lo  have  a  complicated  bifur¬ 
cation  pattern  as  /.  vanes  near  cenain  values,  namely  where 
homoclinic  langencics  are  created.  We  argue  that  the  bifurca¬ 
tion  pattern  is  much  more  irregular  than  previously  reported. 
Our  results  contrast  wnh  the  monotonicity  result  for  the  well- 
understood  onc-dimcnsional  family  =  A.r(  1  -  \  i ,  where 
It  IS  known  that  periodic  orbits  are  created  and  never  annihi¬ 
lated  as  /.  increases.  We  show  that  this  monotonicitv  in  the 
creation  ol  periodic  orbits  never  occurs  tor  anv  one-parameter 
lamilv  of  area  contracting  dilfcomorphisms  of  the  Euclid¬ 
ean  plane,  escluding  cenain  technical  degenerate  cases  where 
our  analysis  breaks  down.  It  has  been  shown  that  in  each 
neighborhood  of  a  parameter  value  at  which  a  homoclinic  tan- 
gency  occurs,  there  are  either  intinitely  many  parameter  values 
at  which  periodic  orbits  are  created  or  infinitely  many  at  which 
periodic  orbits  arc  annihilated.  We  show  that  there  are  huh 
infinitciv  manv  values  at  which  periodic  orbits  arc  created  and 
infinitely  many  at  which  periodic  orbits  arc  annihilated.  We 
call  this  phenomenon  aniimonoionieiiv. 


I.  Introduction 

The  orbii  ot  point  v  under  a  diffeomorphism  of  the  plane  f  is 
the  sequence  {/''(.v)} .  where  for  k  >0.  r  denotes  the  A:-fold 
composition  of  ,/'.  /“*  denotes  the  A:-fold  composition  of  f~' 
and  is  the  identity  map.  Lei  p  be  a  periodic  point  with  penod 
n.  The  stable  manifold  of  the  point  p  is  the  set  {.y  : 

lim^,  /"^Lv)  =  p) .  Similarly,  the  unstable  manifold  of 

p  is  {.Y  :  limj^^^/""*  =  p)  •  We  assume  that  p  is  a  hyperbolic 
saddle,  that  is.  the  eigenvalues  fi .  e,  of  DC  ip)  are  such  that 
1^,1  <  I  <  le,! .  Since  /  is  a  diffeomorphism  of  the  plane,  both 
^'{p)  and  W^ip)  are  curves.  There  exists  a  homoclinic  tangency 
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of  p  at  ^  if  IV^ipi  and  intersea  tangentially  at  q.  The 

homodinic  tangency  of  p  m  q  for  a  one-fwameta  family  /- 
at  A  =  Aq  is  called  nondegenerate  if  W^{p)  and  have 

quadratic  contaa  at  q  and  has  nonzero  velocity  transverse 

to  at  4  as  A  varies  [R].  Any  value  at  which  this  occurs 

is  called  a  nondegenerate  tangency  value. 

A  one-parameter  family  of  maps  is  called  monotone  tncreas- 
mg  {decreasing)  on  an  interval  J  of  parameter  values  if  there  are 
no  bifurcations  for  /.e  J  in  which  penodic  orbits  are  annihilated 
as  A  increases  (decreases,  respeaively).  We  say  /.  is  antimono- 
tone  at  A^  if  periodic  orbits  are  both  created  and  annihilated  as  A 
increases  in  each  neighborhood  of  the  parameter  value  A^ . 

The  only  smooth  family  for  which  monotonicity  has  been 
proved  is  the  quadratic  family  a'j  =  A.v«  1  -  s  =  Douady.  Hub¬ 
bard.  Milnor.  Thurston,  Sullivan,  see  {MT]*;.  By  contrast  we  have 
the  following  theorem. 

Antimonotonicity  The  arem.  Each  disstpative  planar  ditfeomor- 
phism  family  is  antimonotone  at  each  nondegenerate  homoclimc 
tangency  value. 

Note  that  this  result  says  nothing  about  what  happens  near  de¬ 
generate  homodinic  tangency  values,  but  we  believe  this  situation 
is  essentially  the  same  as  for  the  nondegenerate  case. 

We  sketch  the  proof  for  a  model  case.  A  paper  detailing  the 
proof  of  the  general  result  is  in  preparation.  If  two  curves  arc 
tangent  at  A  =  A^  and  move  apart,  so  that  they  do  not  intersect  as 
A  increases  (decreases)  beyond  A^,  then  we  say  contact  is  broken 
at  A^  [contact  is  made  at  A,,,  respectively),  and  we  say  A„  is  a 
contact-breaking  value  [contact-making  \a\\ic,  respectively). 

Bubble  Lemma.  If  A^  is  a  nondegenerate  tangency  value  at  winch 
contact  IS  made,  then  there  are  nondegenerate  tangenev  values  ar- 
bitrarilv  close  to  A^  at  which  contact  is  broken  [and  vice  versa).. 

The  theorem  follows  immediately  from  the  Bubble  Lemma  be¬ 
cause  in  each  neighborhood  of  a  contact-making  nondegenerate 
tangency  value,  infinitely  many  periodic  orbits  are  created  (and 
near  contact-breaking  ones,  infinitely  many  are  annihilated)  (N, 
GS].  Thus,  in  each  neighborhood  of  a  nondegenerate  tangency,  or¬ 
bits  are  both  created  and  annihilated,  as  is  illustrated  in  Figure  I 
for  the  example  of  the  Henon  family. 
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Figure  1.  Small  bubble  in  Henon  family  // i  a  .  ri  = 
A  -  V  -0.3r.  A  l.  5.000  PREITERATES,  a-coordinate 
OF  80.000  ITERATES  PLOTTED  PER  /.  V  ALUE. 


II.  Preliminaries 

For  each  Canior  set  C'  c  H  Newhouse  (N]  detines  a  number  in 
(0.  V!  ealled  ihe  thickness  r'(’i  associated  with  C.  \  "miadle- 
tr  Canior  set  C„  =  I  \  G  ^  is  constructed  inductively  as  follows: 
/  =  [0.  1)  and  I ^  and  /_  ,  are  the  left  and  right  component 
of  I  \  G  .  respectively,  where  is  an  open  inter\al  of  length 
•  1/  !  in  the  middle  of  I  .  The  thickness  of  C,,  is  1 1  -  OMlO  . 
Newhouse  proves  the  following  lemma. 


Thickness  Lemma.  Lci  F  and  H  he  Canior  sets  in  R .  with  H 
hulKF)  and  hu\UH)o,F  both  nonempty,  and  t[H)-  riF)  >  1 
Then  H  n  F  is  nonempty. 


.\  Newhouse  horseshoe  family  N-  is  defined  as  follows.  (See 
Figure  2  on  page  472  for  symbols,  coordinates,  and  the  role  of 
the  constants,  and  see  Figure  3  on  page  472  for  the  first  iterate 
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Figure  2,  Coordinates  for  .V. . 


.V;).  Derine  .V(.v.  ri  =  i.k.v.  (iy)  for  i.v.  iM  e  .1:  .V(.v.  \  i  = 

( I  -  -  r))  for  (.V,  .r)6  B:  N-ix,  .r)  =  (r,  +  -/(I  -  .vi 

+  (i(y-l/2)‘)  for  (.v.  y)  €C:  and  continue  .V  smoothly  to 
the  rest  of  R‘ . 

We  choose  nP  <  I  so  *V-  is  dissipative  (i.e.  |detD(A;  )l  <  1) 
throughout  .-1  u  ,  and  we  choose  a ,  /? ,  y,6,e  such  that  is 
one-to-one  on  .-lu^uC.  This  implies  P  >  2.  Let  A  denote  the 
maximal  invariant  subset  of  ,-1  u  B ;  A  is  a  Cantor  set  and  is  the 
product  A,^  <  A^  of  two  Cantor  sets.  A,^  is  the  projection  of  A 
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onto  the  .v-axis  and  onto  the  r-axis.  We  assume  that  a  and 

P  are  selected  so  that  t(Aj)  •  t(Aj^)  =  p  -  2)“'a(l  -  2a)“'  >  I . 

A  primary  stable  [unstable)  segment  is  a  line  segment  of  the 
form  [0,  1]  X  {y}  where  y  e  A. ,  ({.v}  x  [0,  I]  where  .v  €  A,^ . 
respectively).  .A  primary  unstable  parabola  is  a  parabolic  arc  of  the 
form  .V  {.v,  [1/2  -  1/2  4-e))  where  -v  G  A,^ . 

Newhouse  and  Robinson  show  in  [N.  R].  that  m  elfect.  there 
exist  parameter  values  x  near  homoclinic  tangencies  where  for  a 
proper  choice  of  coordinates  the  map  is  similar  to  Figure  3.  We 
are  assuming  that  the  map  changes  in  a  regular  way  as  /.  vanes, 
thereby  avoiding  technical  complications. 

III.  Proof  of  Bubble  Lemma 
ASSUMING  Newhouse  horseshoe  families  occur 

Let  /.Q  be  a  nondegenerate  tangency  value,  which  we  assume  to 
be  a  contact-making  tangency.  We  assume  that  on  a  small  inteival. 
arbitrarily  near  /.,) .  there  is  a  Newhouse  horseshoe  family.  We 
rescale  that  small  interval  to  be  [0.  1].  The  primary'  tangencies 
( the  tangencies  of  primary  parabolas  with  primary  stable  segments) 
arc  all  conta  making.  We  will  show  that  arbitrarily  near  /.  =  (). 
there  is  a  nondegenerate  tangency  which  is  contact-breaking  and 
is  not  primary. 

The  parabolic  arc  of  the  form  r(r .  4)  =  1 1/2  -f  -s  --60 
for  0  <  4  <  (1  -  2//?)/i'"',.  Sr  <  p~'’  -  2p~"~'  -  c.  V 
lies  in  a  gap  in  the  Cantor  set  of  primary  stable  leaves  as  shown  in 
Figure  4. 


P 


-H 


Figure  4.  The  arc  u(r.c). 
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Lei  ffO  denote  the  set  of  parameters  such  that  rir,  c)  lies 
OP  a  pnmar>'  parabola.  For  each  A  the  vertices  of  the  pnmary 
parabolas  have  v-coordinaies  at  ( -A-i- .  so  we  see  that  Ffs)  = 
-c  -  jS'"  and  the  thickness  of  Hw)  is  equal  to  riA.j.  The 
«th  image  of  tMt.s)  under  N.  is 

-  •  \  /I  -  I  -  /j'l-  I  - 

/.)  =  i(i 

-  A  -  1/2  4-  /  >  -  .;• 

^6{p''  -4/?""'  «c)""‘r  - 

There  is  a  c  =  g ,  /  =  7  at  which  the  r-coordinate  has  a  sta¬ 
tionary  inflection  point  as  shown  in  Figure  5b.  and  4  and  1  sat¬ 
isfy  -1^"“'  -  1/21  =  .  and  !  = 

.  Notice 

|  =  tl/2)(l 

so  for  large  n  we  have  0  <  |  <  ( I  -  llp)P^'"' . 

Claim,  For  fixed  4  <  4.  with  s  -  4  sufficiently  small,  there  ex¬ 
ists  a  A  €  riO  such  that  the  wth  iterate  of  the  primarx’  parabola 
containing  v{i ,  4)  has  a  tangency  with  a  primarx’  stable  segment. 
This  tangency  is  contact-breaking  and  is  nondegenerate  for  2  •-  4  ■ 
The  first  part  of  this  claim  follows  from  the  fact  that  the  local 
maximum  i'(<;.A)  (see  Figure  Sal  of  the  i-coordinate  of 
i\^(t .  s  .  Al  depends  linearly  on  A .  That  is. 

{i’(4  <  A)1A  €  Ff*;)}  =  { .  0)  -  aiA  ^  r(>;)i . 

and  so  {.r(<;.A)|A  €  Fig)}  has  thickness  riA,J.  By  the  Thick¬ 
ness  Lemma,  there  exists  some  A  €  F(4)  such  that  r(4.  A)  €  . 

Note  that  A  is  0(/l~").  Since  A  is  in  F(4).  there  is  a  primarx' 
unstable  parabola  which  contains  elf,  4) .  so  4,  Ai  is  con¬ 
tained  in  the  unstable  manifold  of  .\  and  is  tangent  to  a  pri¬ 
mary  stable  segment  of  A .  As  A  varies  near  0 .  the  position  of 
this  primary  unstable  parabola  is  iMf .  4  +  A) .  Nondegeneracy  and 
contact-breaking  can  be  verified  by  considering  the  i  -coor^inate  of 
d{v^{t,  4+A,  X))/dX  and  noting  that  for  sufficiently  small  4-4  >  0 
and  large  n  this  derivative  is  negative  for  t  sufficiently  close  to 
7. 

We  have  shown  that  there  is  a  primary  stable  leaf  S  and  a  pri¬ 
mary  unstable  parabola  V  so  that  the  nih  iterate  of  U  has  a 
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Figure  5.  The  inflection  value  i . 


Figure  5.  Contact-breaking  tangency  c/  at  a  =  /. . 

coniaci-breaking  langency  with  (see  Figure  6).  Since  the  sta¬ 
ble  and  unstable  manifold  of  the  fixed  point  p  at  (0.0)  contain 
curves  arbitrarily  close  to  5  and  U .  respectively,  we  see  that  p 
will  have  contact-breaking  tangencies  at  parameter  values  arbitrar¬ 
ily  near  A .  Finally,  for  n  large,  this  A  is  near  0 . 
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For  chaotic  scattenni  in  two^eirec'of’freedom  (A^>i2).  time'independent.  Hamiltonian  systems,  scattenni  functions  (i.e.. 
plots  of  the  dependence  of  a  phase  space  variable  al  ter  scattenni  versus  a  phase  space  variable  before  scattenni )  typically  display 
siniulanties  on  a  fractal  set.  For  N>2.  however,  scattenni  functions  typically  do  not  have  fractal  propenies  (even  when  the 
chaotic  invanant  set  is  fractal),  unless  the  fractal  dimension  of  the  chaotic  set  is  lar|e  enou|h.  A  numencal  mvestiiation  of  this 
phenomenon  is  presented  for  a  scatterer  consistini  of  four  reflectini  spheres  at  the  venices  of  a  rc|ular  tetrahedron. 


Recently,  there  nas  been  much  interest  in  the  phe¬ 
nomenon  of  chaotic  scattering  (see  reviews  ( I  ] )  due 
to  its  appearance  in  a  variety  of  applications,  in¬ 
cluding  fluid  mechanics,  celestial  mechanics,  and, 
especially,  molecular  dynamics.  In  addition,  the  im¬ 
plications  of  classical  chaotic  scattering  for  the  cor¬ 
responding  quantum  scattering  problem  is  a  subject 
of  active  research  (2].  Another  line  of  study  con¬ 
cerns  the  question  of  how  chaotic  scattering  comes 
about  and  evolves  as  a  system  parameter  is  varied 
[  3  ] .  In  all  of  these  past  works,  when  specific  systems 
or  examples  are  investigated,  they  have  almost  al¬ 
ways  been  effectively  Hamiltonians  with  two  degrees 
of  freedom.  Since  many  situations  that  will  arise  in 
practice  can  be  expected  to  involve  Hamiltonians 
with  more  than  two  degrees  of  freedoms,  it  is  im¬ 
portant  to  see  whether  new  phenomena,  not  present 
in  two-degree-of-fr<‘edom  systems,  can  be  antici¬ 
pated  in  these  situations. 

In  particular,  let  us  consider  plotting  variables 
characterizing  the  st  ite  of  the  system  after  scattering 
as  a  function  of  a  single  variable  characterizing  the 
state  of  the  system  before  scattering  (with  the  other 
“before-scattering  variables”  held  fixed).  We  call 
such  plots  “scattering  functions”.  It  is  a  striking  hall¬ 
mark  of  chaotic  scattering  in  two-degree-of-freedom 

'  Also  at  Depanmem  cf  Physics. 

^  Also  at  Oepanment  of  Electneal  Engineenng  and  Physics. 


systems  that  these  functions  are  typically  singular  on 
a  Cantor  set  of  values  of  the  variable  characterizing 
the  state  before  scattering.  Here  we  consider  whether 
this  situation  persists  in  systems  with  more  than  two 
degrees  of  freedom.  We  find  that  the  scattering  func¬ 
tion  does  not  typically  display  fractal  properties  in 
V-degree-of-freedom  chaotic  scattering  systems  with 
N>  2,  unless  the  Hausdorff  dimension  of  the  frac¬ 
tal  chaotic  invariant  set  exceeds  a  critical  value.  In 
particular,  if  the  Hamiltonian  is  time  revenible,  then 
fractal  behavior  of  scattering  functions  can  typically 
be  expected  only  if 

Dc>2JV-3.  (1) 

Since  Dc  is  greater  than  or  equal  to  one,  eq.  ( 1 )  is 
satisfied  for  two-degree-of-freedom  chaotic  scatter¬ 
ing  systems  (iV=2).  For  N>2,  fractal  behavior  of 
the  scattering  function  is  typically  always  absent  even 
though  the  chaotic  invariant  set  itself  is  fractal,  pro¬ 
vided  that  I  <Dc<2A^-3.  (Because  the  chaotic  set 
lies  in  the  Df-dimensional  energy  surface 
(^£=2^-1),  we  always  have  Dc^2N-\.)  Since 
Dc  depends  on  system  parameters,  one  expects  that 
a  qualitative  change  in  the  scattering  function  can  be 
observed  as  a  parameter  of  the  system  is  varied 
through  the  critical  value  at  which  Z)c=2iV-3.  Eq. 
( 1 )  is  derived  below. 

We  consider  iV-degree-of-freedom,  time-indepen¬ 
dent,  open  Hamiltonian  systems,  such  that  the  dy- 
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namics  is  time  reversible.  That  is,  i(x=X{t),ps!P(t) 
are  solutions  of  Hamilton’s  equations  (where  x  and 
p  are  the  A^-dimensional  configuration  and  momen¬ 
tum  vectors),  then  x^X{-i),pss-P(-t)  are  also 
solutions.  The  dynamics  will  be  reversible  if  the 
Hamiltonian  is  an  even  function  of  p.  For  example, 

//=i/»-+F(4t).  (2) 

Let  /},  and  denote  the  dimensions  of  the  stable 
and  unstable  manifolds  of  the  chaotic  invariant  set. 
Due  to  the  assumed  time  reversibility  of  the  dynam¬ 
ics.  these  dimensions  must  be  equal, 

(3) 

( Non-timc-reverskble  dynamics  occurs,  for  example, 
when  magnetic  fields  are  present  and  leads  to  Ham¬ 
iltonians  which  are  not  even  functions  of  p.  In  these 
cases,  (3)  need  not  hold.) 

We  shall  be  interested  in  ‘he  dimension  of  inter¬ 
sections  of  sets  lying  in  the  energy  surface.  As' back¬ 
ground,  we  note  the  following.  Let  S|  and  S}  denote 
two  subsets  of  a  i}.-dimensional  manifold,  and  let 
their  dimensions  be  denoted  Z)(S| )  and  If  S| 
and  82  are  smooth  surfaces,  then  generically 

0(S,nS2)=D{S,)+f)(S,)-f).,  (4) 

if  the  right  hand  side  is  nonnegative  and  SinS-  is 
not  empty.  If  it  is  negative,  then  S|  and  S:  do  not 
have  a  generic  intersection.  For  example,  two  one- 
dimensional  lines  in  a  three-dimensional  space  may 
intersect  at  a  point,  but ,.  light  perturbation  of  the 
position  of  the  lines  typically  removes  the  intersec¬ 
tion.  Thus  the  original  intersection  is  not  “generic”. 
We  wish  to  apply  (4)  also  to  the  case  where  S|  is 
fractal  and  f)(S|)  is  its  HausdoriT  dimension  with 
noninteger  value  For  this  purpose,  we  refer  to  the 
theorems  in  ref.  [4].  As  an  example  of  these  results, 
consider  the  case  of  a  fractal  set  S|  lying  in  a  rec¬ 
tangular  region  of  a  plane  (D.  =  2).  Now  randomly 
choose  a  straight  line  S2  in  the  plane  by  first  choosing 
a  point  with  uniform  probability  distribution  in  the 
rectangle  and  then  placing  the  line  through  this  point 
at  an  angle  chosen  randomly  with  uniform  proba¬ 
bility  in  [0,  2n].  If  the  left  hand  side  of  (4)  is  neg- 

"  Formula  (4 )  applies  tf  S,  is  a  Sousiin  set  and  S2  is  a  smooth 

surface.  A  Sousim  set  is  the  union  of  countable  intersection  of 

closed  sets.  See  ref.  (4). 


ative  (i.e.,  Z)(Si)<l  since  D.  =  2  and  D(S2)  =  1), 
then  the  probability  that  the  randomly  chosen  line 
intersects  the  fractal  set  S|  is  zero.  If  the  right  hand 
side  of  (4)  is  positive  (i.e.,  i3(S|)>  1 ),  then  there 
is  a  positive  probability  that  S|  082  is  not  empty;  and. 
furthermore,  if  Si  082  is  not  empty,  then  DiSinS^) 
is  given  by  (4)  with  probability  one. 

We  now  apply  (4)  to  the  chaotic  scattering  situ¬ 
ation.  Since  the  intersection  of  the  stable  and  un¬ 
stable  manifolds  is  the  chaotic  set,  we  see  that  (3) 
and  (4)  with  D.ssDes2N-\  yield 

(5) 

with 

(6) 

We  now  observe  that  the  fractal  set  of  singular  values 
for  the  scattering  function  corresponds '  iints  on 
the  stable  manifold  of  the  chaotic  sc  .  he  orbits 
originating  from  such  paints  asymptote  to  the  cha¬ 
otic  set.  Orbits  originating  near  these  points  will 
spend  a  long  time  “bouncing  aroufid”  in  the  scat- 
terer  before  leaving  the  scattering  region;  that  is,  they 
stay  close  to  the  chaotic  set  for  a  long  time  and  hence 
are  sensitive  to  small  perturbations  of  their  initial 
conditions.  Let  di  denote  the  fractal  dimension  of 
the  set  of  singular  values  of  the  variable  in  the  scat¬ 
tering  function  which  characterizes  the  orbit  before 
scattering.  8weeping  this  single,  before-scattering 
variable  corresponds  to  moving  along  a  curve  in  the 
f>£-4limensional  energy  surface.  Thus  is  the  di¬ 
mension  of  the  intersection  of  the  stable  manifold  of 
the  chaotic  set  with  a  one-dimensional  set,  and  (4) 
yields,  =0,+ 1  -/>£.  or 

<f,=(/.+2-A,  (7a) 

d,  =  \D,+l-N,  (7b) 

where  in  (7b)  we  have  used  (6).  (Note  that  (7a) 
applies  whether  or  not  the  Hamiltonian  is  time  re¬ 
versible.  while  (6)  and  hence  (7b)  require  time  re¬ 
versible  dynamics.)  If  the  right  hand  side  of  (7)  is 
negative,  then  there  is  zero  "probability”  of  inter¬ 
section,  and  we  will  typically  never  observe  fractal 
properties  of  the  scattering  function.  Requiring  d,>0 
in  (7b)  yields  the  previously  stated  condition  for 
fractal  behavior  in  the  scattering  function,  eq.  ( I ). 

We  emphasize  that  the  critical  value,  Dc-2N-X 
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for  observation  of  fractal  behavior  in  the  scattering 
function  results  under  the  assumption  that  the  scat¬ 
tering  function  is  obtained  by  varying  a  single  be¬ 
fore-scattering  variable  holding  all  the  others  fixed. 
If  instead,  we  choose  to  consider  scattering  functions 
which  depend  on  n  independent  before-scattering 
variables  with  the  others  held  fixed,  then  similar 
considerations  can  be  applied.  In  this  case,  fractal 
behavior  in  the  n-independent-variable  scattering 
function  is  typically  observable  if  1 

(for  time  reversible  systems);  and  the  fractal  di¬ 
mension  of  the  set  on  which  the  scattering  function 
is  singular  is  d^aadt+n-^- 1 -N.  In  such  cases  we  say 
that  the  chaotic  scattering  is  an  “/(-dimensional  obK 
servable”.  Since,  as  a  practical  matter,  it  is  much  eas¬ 
ier  to  examine  a  function  of  a  single  independent 
variable,  we  expect  the  one-dimensional  observable 
case  to  be  of  most  interest. 

We  check  the  above  qualitative  features  in  a  sim¬ 
ple  system  exhibiting  chaotic  scattering.  It  consists 
of  a  point  particle  of  unit  speed  bouncing  between 
four  identical  hard  spheres.  The  centers  of  the  spheres 
are  located  at  the  vertices  of  a  regular  tetrahedron 
(fig.  1 )  of  unit  edge  length.  The  spheres  are  labeled 
by  {0.  1 .  2.  3}.  The  coordinates  of  their  centers  { (.v„ 
I’,,  I,),  1=0.  1,  2.  3}  are: 

(co.^'o.  ;o)=(0. 0.  yi) . 

(.'fi.r...-.)  =  (}.-l/2y3.0). 


Fig.  1 .  The  geometry  of  the  scaiterer,  four  reflecting  hard  spheres 
sitting  at  the  venices  of  a  regular  tetrahedron. 


U2.>'2.=j)  =  (-i. -l/2y3.0). 

(ATj.yj,  jj)  =  (0,  l/v/3.0) . 

Thus  the  bottom  of  the  tetrahedron  sits  on  the  plane 
rsO.  The  radius  of  the  spheres  R  is  the  only  ad¬ 
justable  parameter  in  the  system,  and  the  spheres  do 
not  intersect  as  long  as  /{<  j. 

There  are  an  infinite  number  of  trapped  orbits,  pe¬ 
riodic  or  aperiodic,  in  our  system.  These  orbits  are 
all  unstable  since  small  displacements  from  a  trap¬ 
ped  orbit  are  magnified  exponentially  by  the  defo- 
cusing  effect  of  the  spheres.  All  trapped  orbits  can  be 
uniquely  coded  by  a  bi-infinite  sequence  {a,!  of  four 
symbols  {0.  1.  2.  3}  in  the  following  way.  We  intro¬ 
duce  a  discrete  time  as  the  time  of  collision  of  the 
particle  with  one  of  the  four  spheres.  The  symbol  a, 
is  set  to  k  if  the  particle  collides  with  sphere  k  at  time 
(.  Obviously,  the  particle  cannot  hit  the  same  sphere 
it  collided  with  at  the  immediately  previous  time. 
Therefore,  when  R  is  small  enough,  the  sole  con¬ 
straints  on  the  symbol  sequence  of  trapped  orbits  is 
a,  i4a,.  |.  If  the  symbol  sequence  is  perit^ic.  the  cor¬ 
responding  orbit  is  also  periodic.  For  instance,  the 
orbit  bouncing  between  sphere  one  and  sphere  two 
is  of  period  two,  and  its  symbol  sequence  is  {...,  1, 2. 
1,  2, ...} s  ( I,  2],  where  the  square  bracket  denotes 
the  periodicity.  There  are  a  total  of  six  period-two 
orbits;  (0.  1 ).  (0.  2],  (0.  31.  (1.  2).  1 1.  3).  [2.  3). 
There  is  no  penod-one  orbit  due  to  the  constraint 
The  number  of  trapped  periodic  orbits 
grows  exponentially  with  the  period.  The  exponent 
is  the  topological  entropy  of  the  set  of  trapped  orbits. 
For  our  system,  when  R  is  small  enough,  the  topo¬ 
logical  entropy  is  log(3). 

To  proceed,  imagine  the  following  situation.  We 
choose  a  plane  below  the  scattering  tetrahedron  of 
spheres,  j  >  /?.  We  then  consider  trajectories 

originating  from  initial  conditions  (.Vq,  >’o)  on  this 
plane  and  with  initial  velocity  straight  upward  (i.e.. 
parallel  to  the  z-axis).  We  refer  to  (xo,  yo)  as  the  im¬ 
pact  parameters.  For  all  initial  conditions  (xq, 
we  define  a  nennegative  integer  valued  function 
T(xo,  yo)  which  we  call  the  time  delay  function.  Its 
value  is  given  by  the  total  number  of  collisions  with 
the  hard  spheres  experienced  by  the  particle  with  im¬ 
pact  parameters  (Xq,  yo)-  For  almost  all  impact  pa¬ 
rameters,  this  function  is  finite,  corresponding  to  a 
finite  trapping  time  of  the  particle  in  the  system. 
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Fi|.  2.  (a)  Hierarchical  construction  of  the  Cantor  set  structure 
of  the  stable  manifold,  Rs  0.4;  (b)  blowup  of  (a). 


However,  there  are  certain  trajectories  which  remain 
in  the  system  for  an  arbitrarily  long  time.  Initial  con¬ 
ditions  (Xo,  Vo)  for  these  trajectories  are  distributed 
on  a  Cantor  set.  This  Cantor  set  is  the  intersection 
in  the  five-dimensional  energy  surface  of  the  stable 
manifold  of  the  trapped  unstable  set  with  the  two-di¬ 
mensional  plane  z=  -K,  p,=py=0.  The  time  delay 
function  is  singular  on  this  Cantor  set. 

To  see  the  Cantor  set  structure  of  the  stable  man¬ 
ifold,  we  consider  the  particle  trajectories  in  more 


0.4  r 

! 

t 

I 

I 


1 


•0.41 - 

•0.4  0  0.4 

Xo 


Fig.  3.  The  iniencciion  of  the  suble  minifold  with  the  hyper- 
plane  plane  •  A',  p,itp,mO,  RaO.48. 


Fig.  4.  Schematic  illustration  of  the  dimension  d,  as  a  function  of 
R. 

detail.  For  some  impact  parameters,  the  particle  will 
not  hit  any  of  the  four  hard  spheres  and  will  go 
straight  off  to  infinity.  Those  initial  conditions  from 
which  the  particle  hits  one  of  the  four  spheres  at  least 
once  are  the  vertical  projection  of  the  four  spheres 
onto  the  plane  of  initial  conditions.  They  are  the  four 
big  circular  disks  in  fig.  2.  We  denote  this  set  from 
which  orbits  experience  at  least  one  bounce  by  C|. 
Inside  each  big  disk,  there  are  three  small  deformed 
disks,  from  which  the  particle  hits  the  four  spheres 
at  least  twice.  These  are  images  of  the  other  three 
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spheres  in  the  mirror  of  the  first  sphere.  Thus  we  have 
a  set  Cj  of  nine  small  disks  from  which  orbits  bounce 
at  least  twice.  Within  each  small  disk,  there  are  three 
smaller  disks  C3,  from  which  the  particle  hits  the  hard 
spheres  three  or  more  times.  The  resulting  set  of  this 
hierarchical  disk  organization,  given  by  C„  is 
the  Cantor  set  illustrated  in  fig.  3.  Starting  from  any 
point  in  this  set.  the  particle  bounces  between  the  four 
hard  spheres  forever,  never  escaping  to  infinity. 

The  fractal  dimension  of  this  Cantor  set  is  and 


is  related  to  the  dimension  of  the  stable  manifold  D, 
by  It  is  reasonable  to  presume  that  d,  is 

a  monotonically  increasing  function  of  the  radius  R. 
When  R  is  zero,  there  is  no  strange  set  on  the  plane 
of  initial  conditions,  and  hence  d,  is  zero.  For  small 
R,  the  dimension  </,  increases  sharply  with  R, 

d,^\/\n(R~') 

as  can  be  shown  by  an  argument  similar  to  one  given 
in  ref,  1 3 ) .  On  the  other  hand,  if  >  1  ^3,  the  region 


Fig.  S.  (a)  The  time  delay  as  a  function  of  the  distance  /  alon^ 
the  one-dimensional  line  cut  in  a  case  exhibiting  chaotic  scatter 
ing,/?=0.48;  (b)  blowup  of  (a);  (c)  blowup  of  (o). 
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between  the  four  spheres  is  closed  to  the  outside  (in 
this  case,  the  spheres  intersect  since  /(>  ^ ),  and  all 
the  points  in  this  closed  region  are  trapped.  Hence, 
ail  the  points  in  the  closed  region  are  on  the  stable 
manifold  ( i.e..  the  chaotic  set  and  its  stable  manifold 
are  the  same  set ).  The  dimension  of  the  stable  man¬ 
ifold  in  this  case  is  equal  to  the  dimension  of  the  en¬ 
ergy  surface.  D,=  5.  and  thus  </,=  2.  Therefore,  if  we 
vary  R  between  0  and  1 7^3,  the  dimension  rf,  in¬ 
creases  from  0  to  2.  Thus  there  will  be  a  value 


at  which  </,  =  1,  and  the  scattering  will  change  qual¬ 
itatively  as  R  increases  through  R^.  Below  we  will 
not  see  chaotic  scattering  from  a  one-dimensional  cut 
in  the  plane  of  initial  conditions.  A  question  of  prime 
interest  in  this  context  is  whether  Rt<^.l{it  is,  then 
we  will  be  able  to  see  chaotic  scattering  for  typical 
one-dimensional  cuts  for  /?  in  a  range  of  values 
(Rf<R<^)  such  that  the  spheres  do  not  intersect. 

We  used  a  box  counting  algorithm  to  determine 
the  fractal  dimension  </,.  We  cover  the  Cantor  set 


I 


Fig.  6.  (a)  The  cosme  of  the  angle  to  the  ;-axis  made  by  the  ex¬ 
iting  direction  of  the  particle  as  a  function  of  the  distance  /  for 
thesameone-dimensionalcutasinfig.  3;  (b)  blowup  of  (a);  (c) 
blowup  of  (b). 
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generated  above  by  squares  of  edge  length  t,  then  in 
the  limit  e-*0.  the  number  of  squares  N(e)  needed 
for  the  covering  scales  as 

The  exponent  d,  can  be  determined  by  a  least-squares 
fit  of  N(t).  When  f?=0.48.  we  found  (/,  is  approx¬ 
imately  1 .4.  T  hus  we  verify  the  important  result  that 
/?c<  J,  See  the  schematic  illustration  in  fig.  4.  We  also 
computed  d,  at  a  smaller  R  value.  R=0A,  at  which 
we  obtain  t/.s  1.07.  Using  a  linear  extrapolation  from 
these  two  computed  values  of  d„  we  estimate 
«e=0.38. 

We  now  describe  some  of  our  numerical  results  at 
RzzQAi.  Since  r/,=:  1.4>  1.  we  expect,  with  positive 
probability,  to  sec  chaotic  scattering  from  a  ran¬ 
domly  chosen  one-dimensional  cut  in  the  plane  of 
initial  conditions.  The  fractal  dimension  of  the  non- 
esjaping  set  on  this  one-dimensional  line  should  ic 
equal  to  =c/,-- 1  =0.4.  We  check  this  by  generating 
one-dimensional  random  cuts  in  the  plane.  We  pick 
a  random  point  in  the  square  centered  at  the  point 
.v=.va0.  of  edge  length  2R.  Then  we  draw  a  line  at 
a  random  angle  through  this  point.  Restricting  initial 
conditions  to  this  line,  we  then  plotted  the  “time  de¬ 
lay"  (i ...  the  total  number  of  bounces  from  spheres 
experienced  by  a  particle)  as  a  function  of  distance 
I  along  this  line.  Out  of  thirty  such  lines,  we  found 
nineteen  cases  exhibiting  a  fractal  set  of  singularities 
of  the  time  delay  function.  A  typical  form  of  the  time 
delay  function  restricted  to  the  one-dimensional  line 
in  cases  where  we  observe  chaotic  scattering  is  shown 
in  fig.  5a.  From  the  blowups  plotted  in  figs.  Sb  and 
Sc,  we  conclude  that  the  singularities  in  the  time  de¬ 
lay  function  are  apparently  distributed  in  a  fractal 
set.  .Another  way  to  confirm  this  is  to  examine  the 
dependence  of  the  scattering  function  giving  the  ex¬ 
iting  particle  direction.  Fig.  6a  shows  plots  of  the  co¬ 
sine  cf  the  angle  9  to  the  r-axis  made  by  the  velocity 
of  an  exiting  particle  as  a  function  of  distance  /  along 
the  same  randomly  chosen  line  as  was  used  for  fig. 
5.  In  regions  near  singularities,  this  function  oscil¬ 
lates  wildly.  Successive  blowups  of  this  function  (figs. 
6b  and  6c)  show  qualitative  similarity,  again  indi¬ 
cating  fractal  singularities. 

To  determine  the  fractal  dimension  of  the  set  of 
singularities  on  a  one-dimensional  line,  we  use  the 
following  algorithm  (the  usual  box  counting  method 


Fig.  7  ( a )  The  HausdorfT  sum  A'  ( s )  as  a  function  of  s  for  differ¬ 
ent  level  i;  ( b )  the  same  plot  for  a  diffei  .n!  one-dimensional  cut 

yields  an  error  comparable  to  the  fractal  dimen¬ 
sion).  The  lime  delay  function  assigns  naturally  a 
level  structure  to  the  one-dimensional  line.  At  level 
(,  we  measure  the  length  of  all  the  intervals  where  the 
time  delay  function  is  greater  than  or  equal  to  i  and 
denote  them  by  /j.  Then  we  form  the  Hausdorff  sum 

K'{s)=l{l‘y,  (8) 

1 

where  the  sum  is  taken  over  all  intervals  at  level  /. 
When  /  tends  to  infinity,  this  sum  should  give  the 
Hausdorff  5-dimensional  measure  [5].  Therefore,  it 
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is  '.iiflnite  when  s  is  less  than  the  Hausdorff  dimen¬ 
sion  </|  of  the  frac'  rt.  and  is  zero  when  5  is  greater 
than  </,.  Hence,  wc  expect  that  for  sufficiently  large 
level  I.  the  sums  K'is)  for  different  levels  will  all  in¬ 
tersect  with  each  other  at  approximately  the  same 
point  s=dt  given  by  the  Hausdorff  dimension  of  the 
one-dimensional  fractal  set. 

For  R=0Ai.  numerical  calculation  indeed  shows 
that  the  sums  K'^s)  for  large  levels  all  intersea  at 
approximately  the  same  value,  thus  yielding  an  ap¬ 
proximation  to  </,.  Figs.  7a  and  7b  plot  K‘is)  as  a 
function  of  5  for  different  i  for  two  one-dimensional 
line  cuts  of  the  plane  of  initial  conditions.  (Small  i 
data  arc  not  shown  here,  since  the\'  do  not  reflea  the 
fractal  property  of  the  singular  set. )  Within  numer¬ 
ical  errors,  the  interseaion  points  ate  all  centered  at 
<fi  =0.4  ±0.05.  This  value  is  also  consistent  with  re¬ 
sults  obtained  for  other  cuts  exhibiting  chaotic  scat¬ 
tering  and  is  also  consistent  with  our  box  counting 
result  d,s:  1.4. 

When  R=0.25,  the  fractal  dimension  d,  is  less  than 
one.  Consistent  with  this,  from  I  (K)  random  line  cuts 
of  the  plane  of  initial  conditions,  we  did  not  see  any 
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We  piesent  an  eiTkieni  algonilim  for  consmiains  cross-sections  of  chaotic  aiiiactors.  The  technique  is  particularly  useful  for 
studying  the  stniaure  and  fractal  dimension  of  higher  dimensional  aniaaors. 


One  of  the  central  topics  in  nonlinear  dynamical 
systems  theory  is  the  study  of  the  structure  and  or¬ 
ganization  of  invariant  sets  under  the  dynamics.  In 
particular,  the  geometry  of  strange  attractors  { 1  ]  is 
of  particular  interest.  For  such  studies,  the  visual¬ 
ization  of  the  strange  attractor  is  iihportant  for  re¬ 
vealing  structure  as  well  as  characterizing  the  at¬ 
tractor.,  This  presents  problems  when  higher 
dimensional  attractors  are  encountered.  For  exam¬ 
ple.  the  projection  of  an  attractor  whose  fractal  di¬ 
mension  is  greater  than  two  to  a  plane  yields  a  fuzzy 
blob.  Questions  such  as  whether  the  local  structure 
of  a  typical  higher  dimensional  strange  attractor  is 
the  product  of  a  continuum  with  a  Cantor  set  ( 2  ]  or 
IS  more  complex  than  this  cannot  be  answered  by 
simply  taking  a  projection  of  the  attractor.  In  ad¬ 
dition.  numerical  determination  of  the  dimension  of 
higher  dimensional  fractal  sets  by  box-counting  al¬ 
gorithms  can  require  enormous  memory  storage  and 
CPU  time.  If  feasible,  taking  cross-sections  of  the  at¬ 
tractor  ( i.e..  intersections  of  the  attractor  with  a  sur¬ 
face  )  might  offer  a  way  of  both  elucidating  the  ge¬ 
ometry  of  the  attractor  and  of  estimating  its 
dimension. 

In  this  regard,  two  procedures  for  taking  a  cross- 
section  of  a  chaotic  attractor  were  proposed  by  Lor¬ 
enz  (2).  and  the  first  of  them  was  extended  and  fur¬ 
ther  developed  by  Kostelich  and  Yorke  [  3 ).  This  lat¬ 
ter  procedure  is  basically  as  follows.  An  orbit  on  the 
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chaotic  attractor  is  followed  until  it  comes  near  the 
desired  cross-seaion  plane.  Through  a  subsidiary 
calculation,  a  local  approximation  to  the  unstable 
manifold  through  that  point  is  found.  Then  the  in¬ 
tersection  of  the  approximate  unsuble  manifold  and 
the  desired  cross-section  plane  is  determined,  thus 
projecting  the  orbit  point  onto  the  cross-section  plane. 
.Assuming  the  attractor  is  smooth  in  the  unstable  di¬ 
rection  (or  directions),  this  intersection  approxi¬ 
mates  to  a  point  in  the  cross-section  of  the  attractor. 
Repeating  this  procedure  many  times  as  an  orbit  is 
followed,  a  cross-section  picture  of  the  attractor  is 
built  up. 

In  this  note,  we  consider  Lorenz’s  second  proce¬ 
dure  for  taking  numerical  cross-section.  Compared 
to  the  first  procedure,  this  procedure  can  be  easier  to 
implement  and  yield  faster  computer  computation. 
On  the  other  hand,  the  method  has  certain  limita¬ 
tions  which  will  be  discussed.  Consider  an  A^-dimen- 
sional  invertible  map,  x„^.,=F^x„).  Choose  a  com¬ 
pact  volume  V  which  contains  the  chaotic  attractor. 
We  shall  find  the  cross-section  of  an  m-dimensional 
hyperplane  with  the  unstable  manifolds  of  the  in¬ 
variant  sets  contained  in  V.  This  will  typically  in¬ 
clude  the  attractor.  By  inverting  the  map.  the  at¬ 
tractor  becomes  a  repellor.  Consider  a  point  j:  in  V 
and  e.\amine  its  preimages  F~'{x),  F~^{x),  ..., 
F“"(x).  Let  T(x)  denote  the  smallest  value  of  n  such 
that  F~"{x)  IS  not  in  V.  We  call  T(x)  the  inverse 
escape  time  from  V.  Under  the  inverse  map,  ail  points 
in  the  region  V  will  finally  escape  except  for  those  on 
the  unstable  manifolds  of  the  invariant  sets  con- 
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tained  in  V.  This  set,  of  course,  includes  the  lepellor 
of  the  inverse  map  originating  from  the  chaotic  at¬ 
tractor  of  the  forward  map.  Points  on  the  unstable 
manifolds  of  the  invariant  sets  in  V  correspond  to 
singular  points  of  the  inverse  escape  time  function 
(T{z)=oo).  (We  assume  that  the  inverse  map  has 
no  attractors  in  V.  For  example,  the  inverse  of  a 
strictly  contraaive  map  (e.g.,  the  Hinon  map)  can 
have  no  attractors.)  Thus,  if  we  start  initial  condi¬ 
tions  from  a  hyperplane  and  collect  all  the  singular 
points  of  the  inverse  escape  time  function  of  the  map, 
we  find  the  intersection  of  the  hyperplane  with  the 
unstable  manifolds  of  the  invariant  sets  in  V,  and  this 
typically  includes  the  cross-section  of  the  attractor 
with  the  hyperplane.  in  practice,  we  not  not  deter¬ 
mine  the  singular  points  but  rather  we  determine  a 
succession  of  nested  sets  containing  the  singular 
points.  We  do  this  by  computing  x  values  for  which 
T{.:)^N  for  successively  latter  values  of  N.  To  ob¬ 
tain  the  intersection  with  the  attractor,  one  should 
reject  points  which  satisfy  r(x)>A^but  do  not  lie 
approximately  on  the  attractor.  In  principle,  this  can 
be  done  by  calculating  the  Lyapunov  exponents  (or 
other  ergodic  quantities)  of  F  “ '  for  each  x  satisfy¬ 
ing  T{x)^N  along  the  orbit  x,  F~'(x),  .... 
|r-(v-i)(j.)  yy  exponents  will  ap¬ 

proximate  the  negatives  of  the  Lyapunov  exponents 
of  the  forward  map  on  the  attractor,  provided  that 
X  lies  approximately  on  the  attractor.  If  x  does  not 
lie  approximately  on  the  attractor,  then  the  Lyapu¬ 
nov  exponents  for  the  inverse  map  starttng  from  x 
will  approximate  those  for  another  invariant  set  in 
V  and  will  differ  substantially  from  the  exponents  of 
the  attractor.  In  this  case  the  point  x  is  rejected.  It 
will  not  always  be  possible  to  apply  this  Lyapunov 
exponent  test,  because  N  must  be  sufllciently  large 
to  obtain  reliable  estimates  of  the  Lyapunov  expo¬ 
nents  of  the  inverse  map.  Alternatively,  one  can  omit 
the  Lyapunov  exponent  test  altogether.  In  this  case, 
the  set  obtained  may  be  larger  than  that  for  the  at¬ 
tractor.  Thus  a  calculation  of  the  fractal  dimension 
of  this  set  yields  an  upper  bound  for  the  fractal  di¬ 
mension  of  the  attractor.  In  our  numerical  examples, 
we  have  not  applied  the  Lyapunov  exponent  test. 
Nonetheless,  as  shown  below,  for  these  examples,  the 
method  appears  to  yield  very  good  approximations 
to  the  actual  attractor,  and  the  calculated  dimen¬ 


sions  agree  with  previous  calculations  which  re¬ 
solved  only  the  attraaor  set. 

The  dimension  of  the  intersection  set  in  the  cross- 
section  plane  is  related  to  the  dimension  of  the  un¬ 
stable  manifold  set  by  a  result  of  Manila  [6].  If  the 
Hausdoiff  dimension  Z>  of  a  bounded  fractal  set  lying 
in  an  ^dimensional  space  is  greater  than  N—  m,  then 
a  random  cut  by  an  m-dimensional  hyperplane  in¬ 
tersects  the  set  with  positive  probability;  if  it  does 
intersect  the  fractal  set,  the  dimension  d  of  the  in¬ 
tersection  set  is  related  to  D  by 

D=d+(N-m)  (1) 

with  probability  one.  Hence,  by  generating  the  cross- 
section  of  the  attractor  and  measuring  the  dimension 
of  the  cross-section  set,  we  determine  the  dimension 
of  the  strange  attractor. 

To  illustrate  out  algorithm,  we  first  calculate  one- 
dimensional  cross-sections  of  the  Hdnon  attractor. 
The  Henon  attractor  is  generated  by  the  following 
map, 

x„^,=a-xl+by„,  y,+i=x„.  (2) 

At  parameter  values  a  =  1 .4, 6 = 0. 3,  H^non  observed 
that  there  exists  a  chaotic  attractor.  Numerical  box 
counting  techniques  for  the  calculation  of  the  di¬ 
mension  of  a  strange  attractor  were  first  applied  by 
Russell  et  al.  [4],  who  obtained  a  result  for  the  di¬ 
mension  of  the  H6non  attractor.  A  more  accurate  re¬ 
sult  was  obtained  by  Grassberger  who  found  that  the 
capacity  dimension  is  approximately  1 .28  ±  0.0 1  [  S  ] . 
However,  from  different  least  squares  fits  of  the  slope, 
the  dimension  takes  values  between  1.22  and  1.30. 

Fig.  1  shows  the  H^non  attractor.  It  can  be  shown 
that  the  attractor  is  included  in  the  square  [  -  2.0, 
2.0]  Xl -2.0,  2.0).  This  is  the  region  V  which  we 
use  for  calculating  the  inverse  escape  time  function. 
We  take  a  horizontal  one-dimensional  cross-section 
through  the  point  x=0,  ysrO  and  calculate  T{x)  at 
regularly  spaced  intervals  along  this  line.  This  is 
shown  in  fig.  2a.  We  see  there  is  a  natural  Cantor  set 
level  structure  in  the  inverse  escape  time  function. 
At  level  0,  there  is  one  interval  from  which  it  re¬ 
quires  at  least  one  backward  iterate  to  escape  the 
square;  at  level  1,  there  are  two  intervals  from  which 
it  requires  at  least  two  backward  iterates  to  escape 
the  square;  etc.  The  intersection  of  all  these  intervals 
is  the  cross-section  of  the  H6non  attractor.  Fig.  2b 
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Fig.  1.  The  H^non  attractor. 

shows  the  same  function  for  the  vertical  cross-sec¬ 
tion  through  the  same  point  x=0,  yssO. 

To  get  the  fractal  dimension  of  these  cross-section 
sets,  we  use  the  following  procedure.  We  denote  the 
lengths  of  the  intervals  at  level  i  by  /j.  Then  we  form 
the  Hausdorff  sum 

K'{s)=l{l'y,  (3) 

where  the  sum  is  taken  over  all  intervals  at  level  i. 
When  i  tends  to  infinity,  this  sum  is  the  Hausdorff 
5-dimensional  measure  ( 7  ] .  Therefore,  it  is  infinite 
when  5  is  less  than  the  Hausdorff  dimension  d  of  the 
fractal  set,  and  is  zero  when  s  is  greater  than  d.  Hence, 
we  expect  that  for  large  i,  the  sums  versus  5  for 
different  levels  will  intersect  with  each  other  at  ap¬ 
proximately  the  same  point  s=d  given  by  the  Haus¬ 
dorff  dimension  of  the  one-dimensional  fractal  set 
In  fig.  3,  we  show  results  for  the  Hausdorff  sums  for 
different  levels  for  a  typical  one-dimensional  cut.  The 
lines  for  this  case  have  intersections  in  the  range 

*'  The  numerical  application  of  the  Hausdorff  sum  (3)  to  find 
the  fractal  dimension  has  been  previously  used  to  study  cha¬ 
otic  scattering  (8).  Results  of  Nusse  and  Yorke  [9j  guarantee 
that  for  hyperbolic  horseshoes,  an  interval  with  succciii''e 
nested  increasing  T{x)  contains  a  point  where  T{x)  =  x. 


-2  0  2 


b  ( 

Fig.  2.  Inverse  escape  time  function  for  the  Henon  map.  (a )  Hor¬ 
izontal  cut  through  a:=.0,  y=0.  (b)  Vertical  cut  through  x=0, 
y=0. 

r/wO.24  to  0.30.  Examining  many  different  one-di¬ 
mensional  horizontal  and  vertical  cuts,  we  estimate 
d  to  lie  in  the  range  0.20  to  0  34.  From  formula  ( 1 ), 
the  dimension  of  the  Henon  attractor  is  approxi¬ 
mately  £>«  1.20-1.34.  The  whole  calculation  for  a 
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Fig.  3.  The  HausdorfT  sum  A'(s)  as  a  function  of '  for  different 
levels  I  for  the  one-dimenstonal  vertical  cut  through  xaO.8, 
y^O.O. 


cut  involved  very  little  computer  memory  and  took 
less  than  5  seconds  on  the  Cray  XMP  computer. 

Our  second  example  is  the  double  rotor  attractor 
generated  by  the  following  four-dimensional,  vol¬ 
ume-contracting  map  [10], 


a-i-'CD-a)-*'- 

r'/  'M'S/  \(C2/27i)sin(27ur')/ ' 


Here  .V|,  .Vj  take  values  from  the  unit  interval  (0, 1 ), 
and  and  V:  *  ike  values  from  the  real  line.  At  pa¬ 
rameter  values  iven  by 

_5.8  -6.602\ 

•  '~V_6.602  -12.40/’ 

_/0.7496  0.1203\ 

Vo.  1203  0.8699/’ 


C|  =0.3536,  c,  =0.5, 

Kostelich  and  Yorke  [  3  ]  find  that  there  is  a  chaotic 
attractor.  Since  the  two  ^--directions  of  the  double 
rotor  map  are  compact,  we  choose  for  V  the  hyper- 
cube  box  given  by  maxfly,  |,  1>'2]  Starting 

from  a  uniform  distribution  of  initial  points  in  the 


cross-section  plane,  we  collect  those  points  from 
which  after  some  chosen  maximum  number  of  it¬ 
erates  of  the  inverse  map  nmtx<  the  point  remains  in 
the  hypercube  region.  Fig.  4  shows  two  two-dimen¬ 
sional  cross-sections  of  the  attractor  using  our  al¬ 
gorithm  (ymM=0-5  and  n„„==l5).  The  pictures  in 
fig.  4  appear  to  be  identical  to  those  in  ref.  [3]. 

To  find  the  fractal  dimension  of  the  chaotic  at- 


Fig.  4.  Cross-sections  of  the  double  rotor  attractor,  (a)  Cross- 
section  at  y;=0.  >’2=0.  (b)  Cross-section  at  )’i=0,X|.=  2  2/2n 
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Fig.  i.  {»)  N{()is»  function  of  <  for  the  cross-section  set  in  fig. 
4a.  The  least  squares  fit  gives  a  capacity  dimension  <f  =  1 .67  ±  O.OS. 
(b)  The  same  plot  for  fig.  4b.  The  least  squares  fit  gives 
d=  1.63  ±0.05. 

tractor,  we  used  a  box  counting  algorithm.  We  cover 
the  resulting  cross-section  set  with  squares  from  a  grid 
of  edge  length  e.  In  the  limit  e-*0,  the  number  of 


squares  N(f)  needed  for  the  covering  scales  as 
/VfO-e-',  (5) 

The  exponent  d  is  determined  by  a  least  squares  fit 
of  a  straight  line  to  a  log-log  plot  of  N{().  In  fig.  S, 
we  calculate  the  capacity  dimension  d  for  the  cross- 
section  sets  of  figs.  4a  and  4b.  The  two  values  of 
Dxd+l  determined  from  least  squares  fitting  are 
3.67  and  3.63.  According  to  the  estimates  of  ref.  { 3  ] , 
the  information  dimension  lies  in  the  range  3.61  to 
3.68.  Thus  we  find  that  the  values  of  the  capacity  and 
information  dimensions  (the  latter  must  be  smaller) 
are  apparently  quite  close  to  each  other. 

In  conclusion,  we  have  presented  an  efficient 
algorithm  for  calculating  cross-sections  of  strange  at¬ 
tractors.  This  method  may  be  useful  for  the  esti¬ 
mation  of  the  fractal  dimensiqn  of  higher  dimen¬ 
sional  chaotic  attractors. 
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ported  by  the  Office  of  Naval  Research  (Physics), 
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ences)  and  by  the  Advanced  Research  Projects 
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Abatracl.  We  present  a  new  lechniq  e  for  constructing  a  compuler'assisted  proof  of 
the  reliability  of  a  long  computer-generated  trajectory  of  a  dynamical  system.  Auxiliary 
calculations  made  along  the  noise-corrupted  computer  trajectory  determine  whether  there 
exists  a  true  trajectory  which  follows  the  computed  trajectory  closely  for  long  limes.  A 
major  application  is  to  verify  trajectories  of  chaotic  diflerential  equations  and  discrete 
systems,  We  apply  the  mam  results  to  computer  simulations  of  the  Henon  map  and  the 
forced  damped  pendulum. 

AMS  classification  scheme  numbers;  S8F)3,  S8F15,  6SG0S,  6SL70 


I.  Iniroduclion 

Are  numerical  studies  of  chaotic  systems  reliable?  More  specifically,  do  computer 
trajectories  ‘correspond’  to  actual  trajectories  of  the  system  under  study?  The  answer  is 
sometimes  no.  In  other  words,  there  is  no  guarantee  that  there  exists  a  true  trajectory 
that  stays  near  a  given  computer-generated  numerical  trajectory. 

The  question  is  especially  pivotal  for  chaotic  systems.  Chaotic  trajectories  exhibit 
sensitive  dependence  on  initial  conditions;  two  trajectories  with  initial  conditions  that 
are  extremely  close  tend  to  diverge  exponentially  from  one  another.  At  the  same  time,  a 
great  deal  of  phenomenological  research  on  chaotic  systems  relies  heavily  on  computer 
simulation. 

Therefore,  the  use  of  an  ODE  solver  on  a  finite-precision  computer  to  approximate 
a  trajectory  of  a  chaotic  dynamical  system  leads  to  a  fundamental  paradox.  Because 
of  sensitive  dependence  on  initial  conditions,  a  small  truncation  or  rounding  error 
made  at  any  step  during  the  computation  will  tend  to  be  greatly  magnified  by  future 
evolution  of  the  system.  Under  what  conditions  will  the  computed  trajectory  be  close 
to  a  true  trajectory  of  the  model? 

Consideration  of  simple  examples  of  nonlinear  maps  illustrate  that  there  are  critical 
points  of  trajectories  where  round-off  error  or  other  noise  can  introduce  new  behaviour. 
We  discuss  typical  examples  in  section  2.  At  such  'glitches’  the  true  trajectories  all 
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diverge  from  the  numerical  trajectory.  In  this  case,  there  will  be  no  true  trajectory  that 
stays  near  the  numerical  trajectory.  In  other  cases,  the  numerical  trajectory  can  be 
shadowed :  some  true  trajectory  remains  close  to  the  numerical  trajectory. 

In  the  present  work  we  state  a  result  (theorem  3.3)  which  says  that  if  certain 
quantities  evaluated  at  points  of  the  computer-generated  trajectory,  called  a  pseudo’ 
trajectory,  ate  not  too  large,  then  there  exists  a  true  trajectory  near  the  computer¬ 
generated  one.  Rigorous  upper  bounds  for  these  quantities  can  be  generated  by  the 
computer  as  it  produces  the  pseudo-trajectory.  If  these  quantities  satisfy  the  hypotheses 
of  the  theorem,  which  again  can  be  rigorously  checked  by  the  computer,  the  result 
is  a  computer-assisted  proof  of*the  existence  of  a  true  trajectory  near  the  computer¬ 
generated  pseudo-trajectory.  For  example,  if  the  one-step  errors  in  the  pseudo-trajectory 
occur  in  the  tenth  decimal  place,  then  the  true  trajectory  that  results  ^om  the  theorem 
differs  from  the  computer-generated  trajectory  in  approximately  the  fifth  decimal  place. 
In  particular,  the  initial  point  of  the  true  trajectory  can  differ  from  the  initial  condition 
of  the  pseudo-trajectory  at  most  in  the  fifth  decimal  place. 

A  typical  application  of  the  theorem  is  to  the  forced  damped  pendulum 

j!  +  ay  +  sin  y  =shcost. 

Setting  the  parameters  a  =»  0.2  and  b  -  2.4,  we  prove  the  existence  of  an  apparently 
chaotic  trajectory  with  initial  cor  itions  y(0)  =  y’{0)  =  0  for  time  t  ranging  from  t  -  0 
to  t  *  lO^n.  This  trajectory,  for  all  0  ^  t  ^  lies  within  10"’  of  an  explicit 
computer-generated  (noisy)  trajectory  produced  with  a  one-step  error  of  10"'*.  There 
are  similar  results  for  other  initial  conditions  and  other  choices  of  a  and  b. 

To  describe  the  theorem,  we  make  a  distinction  between  discrete  and  continuous 
models.  Computational  methods  for  approximating  trajectories  of  systems  of  ordinary 
differential  equations  work  by  a  series  of  small,  discrete  steps.  We  can  therefore  consider 
computer  simulation  of  discrete  systems  and  autonomous  differential  equations  at  the 
same  time  if  we  define  a  dynamical  system  to  be  an  invertible  map  /  on  R".  (We 
actually  define  dynamical  system  a  little  more  generally,  as  a  sequence  of  maps  {fj  on 
R”*,  to  also  cover  the  non-autonomous  differential  equations  case.)  We  will  try  to  keep 
this  distinction  clear  by  using  the  word  trajectory  for  continuous  systems  and  orbit  for 
discrete  systems. 

Consider  then  a  ^-pseudo-orbit  of  a  discrete  system  /,  which  we  can  imagine 
having  resulted  from  applying  a  one-step  quadrature  method  with  truncation  error  S 
to  a  system  of  differential  equations  on  R”*,  m  ^  2.  Assume  that  we  have  subspaces 
and  U,  at  each  point  of  the  pseudo-orbit,  which  are  self-consistent  with  tolerance  S. 
By  this  we  mean  that  and  U„  are  complementary  subspaces  of  the  tangent  space  R” 
at  x„  (see  figure  1),  that  unit  vectors  in  U„  are  mapped  by  /  to  within  d  of  and 
similarly  for  S„.  [>efine  the  positive  number  r„  to  be  an  upper  bound  for  the  expansion 
rate  of  the  linearization  Df  along  S„,  and  r„  to  be  an  upper  bound  for  the  expansion 
rate  of  D/~'  along  U„.  See  section  3  for  precise  definitions. 

The  quantities  which  need  to  be  measured  to  assure  the  existence  of  a  nearby  true 
orbit  are  most  easily  expressed  as  recurrence  relations.  Set  up  a  recurrence  relation  C„ 
by  beginning  with  Co  =  0,  and  recursively  defining  C„  =  csc9„  where  f/„  is 

the  angle  between  S„  and  U„.  Define  D„  similarly;  0^  =  0,  where  N  is  the  length  of 
the  pseudo-orbit,  and  D„  =  esc  +  ^n^n+l  for  n  <  fV.  Then  as  long  as  the  quantities 
C„  and  D„  are  not  too  large  for  all  n,  there  is  a  true  orbit  of  /  near  the  pseudo-orbit. 
More  precisely; 
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FlfHrc  I.  The  splitting  of  the  tangent  space  at  the  nth  point  of  the  pseudo-orbit. 

Theorem  3.3.  Assume  t)  <  I /20m*  and  let  B  be  a  bound  on  the  first  and  second 
partial  derivatives  of  /  and  If 

max{C,.Z)„}  < 

for  all  n  =s  0 . N,  then  there  exists  an  orbit  {w,}  of  /  such  that  \x„  --  wj  <  >/^  for 

n  =0 . JV. 

Note  that  we  do  not  need  to  assume  uniform  contraction  and  expansion  along  the 
directions  and  U,.  In  other  words,  and  t^  do  not  need  to  be  less  than  one  for 
all  n. 

The  proof  of  the  theorem  is  constructive,  in  the  sense  that  it  uses  a  procedure  for 
refining  noisy  orbits  originally  given  in  [6].  The  essential  point  of  the  proof  is  to  show 
that  under  the  conditions  of  the  theorem,  the  iterated  application  of  the  refinement 
procedure,  beginning  with  the  pseudo-orbit,  results  in  a  sequence  of  refined  pseudo¬ 
orbits  with  decreasing  noise  level,  and  whose  limit  is  a  true  orbit.  In  addition,  the  true 
orbit  is  not  too  far  from  the  original  pseudo-orbit. 

The  proof  can  also  be  considered  a  justification  for  using  the  refinement  process 
computationally  on  the  actual  noisy  orbit  to  reduce  noise  to  near  machine-precision, 
but  that  is  a  separate  issue  from  the  main  question  we  are  answering  here.  This 
direction  is  taken  up  in  [7]. 

A  true  orbit  that  stays  near  the  pseudo-orbit  is  said  to  shadow  the  pseudo-orbit. 
Several  years  ago,  Anosov  and  Bowen  proved  shadowing  results  for  hyperbolic  maps 
on  a  differential  manifold.  The  conclusion  of  Anosov  [I]  for  a  hyperbolic  map  says 
that,  given  any  prescribed  shadowing  distance  e  (between  the  pseudo-orbit  and  true 
orbit)  there  exists  a  ^  >  0  so  that  any  ^-pseudo-orbit  can  be  c-shadowed  by  a  true 
orbit.  Bowen  [2]  showed  that  the  same  result  holds  if  the  map  is  required  only  to  be 
hyperbolic  on  a  basic  set  containing  the  orbit.  Other  proofs  have  been  given,  and  one 
more  is  a  consequence  of  the  present  work. 

There  are  two  factors  that  make  the  approach  of  Anosov  and  Bowen  impractical  for 
use  in  computer  experiments.  First,  the  5  that  is  produced  can  be  orders  of  magnitude 
smaller  than  the  machine  epsilon  of  existing  digital  computers.  Second,  most  interesting 
dynamical  systems  currently  being  studied  are  not  hyperbolic. 

Theorem  3.3  docs  not  assume  that  the  dynamical  system  is  hyperbolic.  Our 
approach  is  to  prove  that  as  long  as  the  system  is  sufficiently  hyperbolic  along  the 
(finite  length)  numerical  trajectory,  then  that  piece  of  the  numerical  trajectory  can  be 
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shadowed  by  a  true  trajectory.  On  the  other  hand,  when  /  is  hyperbolic.  C„  and  D„ 
stay  uniformly  bounded  for  all  iterates  n,  in  whic’.i  case  arbitrarily  long  shadowing 
trajectories  are  constructed  by  the  theorem  for  sufficiently  small  5.  Thus  the  shadowing 
theorem  of  Anosov  and  Bowen  is  a  consequence  of  theorem  3.3,  as  is  noted  in  [9]. 

In  [5,6]  a  method  is  developed  which  creates  computer<assisted  proofs  of  the 
existence  of  finite  length  shadowing  orbits  on  a  case'by>case  basis.  In  two  dimensions, 
a  small  parallelogram  is  constructed  near  each  point  of  the  numerical  orbit  in  such  a  way 
that  there  is  a  guarantee  of  a  true  orbit  whose  nth  point  lies  in  the  nth  parallelogram. 
They  apply  the  method  to  one-dimensional  maps  and  the  two-dimensional  Henon  and 
Ikeda  maps,  none  of  which  are  hyperbolic.  These  papers  use  auxiliary  calculations  in 
96-bit  precision  to  verify  that  there  are  true  orbits  near  the  pseudo-orbit,  which  was 
produced  in  48-bit  precision. 

The  advantage  of  the  present  method  over  [6]  is  that  the  auxiliary  calculations 
can  now  be  done  in  the  same  precision  in  which  the  orbit  was  calculated.  For  the 
maps  mentioned  above,  only  48-bit  precision  is  needed  to  verify  the  existence  of  a 
pseudo-orbit  produced  in  48-bit  precision. 

This  fact  is  especially  important  when  attempting  to  shadow  differential  equations. 
We  found  that  the  methods  of  [6]  were  not  practical,  at  least  for  the  di^erential 
equations  we  tried.  For  example,  in  order  to  produce  long  shadowable  pseudo¬ 
trajectories  for  the  forced  damped  pendulum,  we  needed  to  use  a  one-step  error  of  no 
more  than  10~'^  which  already  requires  96-bit  precision.  In  this  case,  there  is  no  extra 
precision  available  for  the  auxiliary  calculations  of  [6]. 

Thus  the  new  method,  superior  even  for  maps,  is  evidently  essential  for  shadowing 
differential  equations.  The  improvement  is  largely  gained  by  sublimating  the  refinement 
process,  done  explicitly  in  a  computer-aided  proof  in  [6],  into  the  proof  of  theorem 
3.3.  It  is  proved  here  that  under  the  hypotheses  of  the  theorem,  the  refinement  process, 
when  iterated,  theoretically  converges  to  a  true  trajectory. 

The  main  result  of  this  paper  was  announced  in  [9],  in  a  slightly  less  streamlined 
form.  Other  work  along  these  lines  for  the  one-dimensional  case  is  reported  in  [3]. 

In  the  next  section,  it  is  shown  by  example  that  shadowing  can  fail  for  some 
pseudo-trajectories.  The  details  of  the  main  theorem  (theorem  3.3)  are  presented  in 
section  3.  Section  4  consists  of  a  number  of  remarks  relevant  to  the  implementation 
of  the  computer  algorithm  based  on  theorem  3.3.  Examples  are  given  in  section  S,  and 
section  6  contains  the  proof  of  the  main  theorem. 


1  Why  shadowing  works 

What  makes  it  possible  to  find  a  true  orbit  near  a  pseudo-orbit  in  the  presence  of 
sensitive  dependence  on  initial  conditions?  The  short  answer  is  hyperbolicity  along  the 
pseudo-orbit.  Even  for  a  non-hyperbolic  dynamical  system,  as  long  as  the  pseudo-orbit 
avoids  areas  of  phase  space  that  lack  hyperbolicity,  it  may  be  possible  to  find  a  nearby 
true  orbit.  Of  course,  on  typical  ergodic  chaotic  attractors,  this  avoidance  is  only  done 
as  a  matter  of  degree.  Roughly  speaking,  the  pseudo-orbit  must  stay  far  away  from 
non-hyperbolic  areas  compared  with  the  size  of  the  errors  being  made.  Our  method 
essentially  relies  on  measuring  how  successful  the  trajectory  is  in  staying  hyperbolic. 

As  a  simple  example,  imagine  a  map  which  contracts  distances.  Assume  that  the 
distance  between  any  two  points  x  and  y  is  decreased  by  a  factor  of  K  by  the  map  /, 
where  0  <  K  <  1.  Thus  |/"(.v)  -  /"(y)|  ^  K"|.x  -  y|.  It  follows  that  any  pseudo-orbit 
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can  be  shadowed  by  the  true  orbit  beginning  at  its  own  initial  condition.  AH  distances 
are  contracted,  including  errors  that  are  made  along  the  pseudo>orbit. 

To  be  more  precise,  let  a  ^ -pseudo-orbit  be  denoted  by  {.Xo,x,,. Then 
l/(xo)  -  .<ii  <  and  further 

!/^(aco)  -  ■'Cjl  <  l/^(xo)  -  /(x,)|  +  \f(x^)  -  X2I 
<  K|/(xo)-x,|  +  |/(x,)-Xj| 

<(K-I-1)5. 

Continuing  in  this  way,  |/"(xo)  -  x,|  <  (K"“'  +  +  ...  +  l)d,  and  we  can  see  that 

the  true  orbit  {.Vo./lxo) . shadows  the  pseudo-orbit  within  5/(1  -  K). 

Although  this  hyperbolic  map  is  not  sensitive  to  initial  conditions,  it  is  an 
instructive  example.  C'nsider  next  a  diffeomorphism  which  expands  distances,  so 
that  |/"(x)  -  /"{y)|  ^  fC"|x  -  >'|  for  K  >  1.  This  map  is  sensitive  to  initial  conditions, 
yet  any  pseudo-orbit  {.Vo.x,....,.X/^}  can  easily  be  shadowed.  The  inverse  of  the  map 
contracts  distances,  so  the  true  orbit  will  shadow  the 

pseudo-orbit  within  5/(1  -  \/K). 

A  general  hyperbolic  dynamical  system  is  a  combination  of  the  above  two  examples. 
At  each  point,  some  directions  are  expanding  and  the  rest  are  contracting.  To  construct 
a  true  orbit,  one  needs  to  use  information  from  the  beginning  of  the  pseudo-orbit  in 
the  contracting  directions  and  from  the  end  of  the  pseudo-orbit  in  the  expanding 
directions.  This  idea  is  the  basis  of  theorem  3.3. 

On  the  other  hand,  not  every  pseudo-orbit  can  be  shadowed.  This  is  not  a  failure  of 
any  particular  shadowing  procedure.  The  simplest  examples  of  nonlinear  maps  provide 
cases  of  pseudo-orbits  for  which  there  is  no  corresponding  true  orbit  nearby.  Consider 
the  one-dimensional  logistic  map  /  (x)  1  -  2x^  shown  in  figures  2  and  3.  The  interval 

/  =  [-1, 1]  maps  onto  itself  under  /  and  so  is  an  invariant  set.  True  orbits  which  begin 
in  /  remain  in  /  for  all  time. 


Fi(iirc  2.  A  pseudo-orbit  of /(x)  =  1  -2x^  which  cannot  be  shadowed.  The  initial  condition 
IS  the  dot  at  the  origin.  An  error  of  size  d  is  made  in  computing  /  (0),  which  causes  the 
orbit  to  eventually  approach  -00. 

Now  consider  the  5 -pseudo-orbit  which  begins  with  Xq  =0,Xi  =  1  +  5,  and  which 
from  then  on  is  computed  without  error.  Then  x,  =/(x,)  <  -1,  and  the  pseudo-orbit 
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Fi|m  i.  For  the  map  f{x\  ■  I  -  2.x-,  an  tniiial  condition  m  the  open  interval  tf  length 
around  zero  can  be  attracted  to  -x  it  an  error  of  size  i  is  made. 

diverges  to  -x.  See  figure  2.  Clearly,  there  .to  true  orbit  of  the  system  /  which 
shadows  the  pseudo*orbit  by  a  distance  of  less  than  I.  Any  true  orbit  within  1  unit  of 
•Xq  a  0  must  stay  wivnin  /  for  aU  time. 

In  this  simple  case,  points  escape  from  true  behaviour  near  the  critical  point,  or 
fold,  of  the  map.  Informally,  we  call  such  a  divergence  from  legal  behaviour  a  glitch. 
In  general,  the  logistic  map  /(.x)  =  u(l  -  x*)  -  I  will  have  ps«udo*orbits  that  cannot 
be  shadowed  not  only  for  a  »  2  as  above,  but  when  the  parameter  a  is  less  than  and 
within  ^  of  2,  where  6  is  the  noise  level  of  the  process.  (This  corresponds  to  the  critical 
value  of  the  fold  in  figure  2  being  between  I  —  S  and  1.)  Thus  the  occurrence  of  a 
glitch  is  a  robust  phenomenon.  The  same  phenomenon  occurs  in  higher-dimensional 
chaotic  dynamical  systems,  because  of  the  folds  caused  by  homoclinic  tangencies  and 
near-tangencies  of  stable  and  unstable  manifolds. 

How  often  should  we  expect  glitches?  The  answer  should  depend  on  the  noise  level 
6.  In  the  logistic  map  example  /(.x)  =  1  -2.v%  there  is  an  interval  of  length  i/Sj  around 
/  ' '  for  which  it  is  possible  for  an  error  of  size  d  to  cause  a  glitch.  This  is  illustrated 
ture  3.  Any  initial  condition  in  the  designated  interval  around  0  is  susceptible  to 
.ig  mapped  to  a  value  greater  than  I,  and  therefore  mapped  out  of  /,  towards  ~x. 
computer-generated  orbit  of  that  type  does  not  correspond  to  any  true  orbit. 

If  we  assume  that  this  interval  of  length  is  sampled  by  the  dynamical  systenr. 
approximately  in  proportion  to  its  length,  we  expect  a  glitch  to  occur  on  the  order  of 
every  l/x/3  steps.  Numerical  studies  in  [6]  on  two-dimensional  maps  and  the  studies 
of  differential  equations  undertaken  for  this  work  roughly  support  this  scaling. 


3.  Shadowing  theorem 

The  theorem  can  be  used  to  shadow  diifeomorphisms  or  differential  equations.  To 
include  both  cases,  we  will  consider  a  dynamical  system  to  be  a  sequence  /q.-.-./n  of 
C^-diffeomorphisms  on  R”  for  some  positive  integer  N. 

When  attempting  to  shadow  a  discrete  map  /,  we  will  use  /„  =  /  for  all  «.  For  a 
non-autonomous  differential  equation  .x  =  F{t,x),  we  would  let  /„  be  the  map  on  phase 
space  which  takes  an  initial  point  x  at  time  t  to  the  point  on  the  trajectory  time  at  time 
t  +  /i„,  where  h„  is  the  current  step  size  of  the  ODE  solver.  If  we  assume,  for  simplicity, 
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that  the  difTerential  equation  is  being  solved  with  a  constant  step  size  h,  then  h„=sh  for 
all  n.  In  this  case,  the  ODE  solver  induces  a  map  called  the  time-ii  map  of  the  system. 

In  the  case  of  an  autonomous  differential  equation,  the  induced  time-h  map  will  be 
the  same  for  all  t.  On  the  other  hand,  if  the  differential  equation  is  non-autonomous, 
the  time-/i  map  will  depend  on  t.  The  following  definition  of  an  orbit  of  a  dynamical 
system  is  made  to  include  both  the  autonomous  and  non>autonomous  cases. 

Definition  3.1.  Let  N  be  a  positive  integer,  and  let  R”  be  a  C^- 

difleomorphism  for  each  0  <  n<N.  The  finite  sequence  {y„},n  **0,...,N  of  points  in 
R'*  is  called  an  orbit  of  the  dynamical  system  {f^},n  -  1  if for 

rt  »0....,N  -  1.  An  orbit  is  sometimes  referred  to  as  a  true  orbit  to  contrast  with  the 
notion  of  pseudo-orbit.  The  finite  sequence  {.>:„}  is  called  a  S -pseudo-orbit  of  {/„}  if 
“  <  6  for  rt  ~0,...,N  -  1.  The  6 -pseudo-orbit  is  c-shadowed  by  the 

orbit  {>•,]  of  the  dynamical  system  {/,}  if  |.x„  -y„|  <  e  for  n  =0 . ,V. 

Here,  as  below,  we  use  the  Euclidean  norm; 

/ «»  \i/J 

'•i«i 

for  a  vector  v  = 

We  also  need  to  define  the  concept  of  moving  frame  from  the  point  of  view 
of  computer  simulation.  The  moving  frames  we  will  require  will  be  numerical 
approximations  S,  and  to  the  stable  tangent  space  and  the  unstable  tangent 
space  at  x^,  if  they  exist,  and  the  next  best  thing,  if  they  do  not. 

Let  N  and  It  be  positive  integers.  For  each  n  =  0 . <V  -- 1,  let  be  a  non-singular 

mxm  matrix.  For  each  n  =  0.....iV  let  lr„, . be  a  set  of  k  vectors  in  U",  and 

define  to  be  the  m  x  It  matrix  with  columns  i>„, . t'„*. 

Definition  3.2.  The  set  {r„, . is  called  a  6-pseudo-frame  for  ihe  dynamical 

system  {J^\  if  for  all  0  <  n  ^  N, 

1.  The  entries  of  the  I:  x  It  matrix  aIa„  -  are  no  larger  than  6  in  absolute  value; 

2.  . are  each  within  6  of  range(/l„^,). 

Informally,  we  call  property  I  of  the  definition  almost-orthogonality,  and  property 
2  consistency. 

The  usefulness  of  this  definition  for  computer-assisted  proofs  lies  in  the  fact  that 
a  6 -pseudo-frame  consisting  of  machine-representable  numbers  can  be  constructed 
using  standard  computational  procedures.  Assume  that  we  begin  with  a  set  of  k 
vectors  {iqi. •■•.I’o*}  in  which  form  an  orthonormal  set.  (That  is.  the  vectors  in 
the  set  are  mutually  orthogonal  unit  vectors.)  Assume  further  that  the  components 
of  the  vectors  Voi»”  «%  nf®  machine-representable  floating  point  numbers.  Then  we 
use  the  Gram-Schmidt  orthogonalization  procedure  on  the  set 
define  {c,,, . . . ,  to  be  the  machine-stored  vectors  that  result  from  this  finite-precision 

computation.  (In  some  cases  we  found  that  a  more  stable  form  of  orthogonalization  [4] 
improved  this  step.)  Continuing  in  this  way  for  0  ^  n  ^  (V  we  define  a  6 -pseudo-frame 
for  a  small  number  6,  such  that  each  vector  in  the  frame  is  machine  representable. 
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We  can  now  describe  the  main  theorem.  For  each  0  ^  n  <  N ,  let  f„  :  R”  -*•  R” 
be  a  C^-diffeomorphism.  Let  be  a  ^ -pseudo-orbit  of  the  dynamical  system 

{/„}.  Define  J„  =  Df{x„)  to  be  the  matrix  of  first  partial  derivatives  of  f„.  Let  15, 
(respectively  82)  be  an  upper  bound  for  the  absolute  values  of  the  first  (respectively, 
second)  partial  derivatives  of  the  component  functions  of  f„  and  on  the  union  of 
balls  of  radius  centred  at  x„  for  n  =  0,...,1V.  Set  B  =max{2,B,,B2}'  Fof  positive 

integers  k+l  =  m,  let  {s,, . (respectively,  {m„„  . . . ,  u„,}i;Lo)  be  a  ^-pseudo-frame 

for  {J“'}  (respectively,  {J„})  such  that  spans  R”  for  each  n. 

Define  the  subspaces  S„  =  span{s„,,,..,s„4},  U„  =  span{«„,,...,M„,},  and  define  6„ 
to  be  the  angle  between  S„  and  U„.  Let  r„  and  t„  be  numbers  satisfying 

<  My  I  for  y  €  S„ 

\J~':\  ^  t,|:l  for  z  e  U„+,. 

Define  Q  =  O.C„  =  csc0„  +r„_iC„_|  for  n  >  0.  Similarly,  define  =  0,D„  = 
cscd„  for  n  <  /V. 

Theorem  3.3.  Let  {.x„}JLo  be  a  d -pseudo-orbit  for  the  dynamical  system  {/„}  on 
R’",m  ^  2,  and  assume  that  <5  <  l/20»i*.  If 

max{C„D,}^ 

for  all  n  =  0 . N,  then  there  exists  an  orbit  {w„}  of  {/,,}  such  that  |x„  -  w„l  <  \/^  for 

n  =  0 . N. 

Theorem  3.3  gives  an  alternative  approach  to  Bowen's  shadowing  lemma  (2].  Let 
/  :  R"  be  a  C^-difT<*omorphism.  A  compact  invariant  set  A  is  called  hyperbolic 

if  there  is  a  continuous  splitting  of  the  tangent  space  T’^R"  =  £J  ©  £“  for  x  €  A,  and 
positive  constants  /  <  1,C  >  0  such  that 

1.  Df{x){E\)  =  E}^,, 

2.  D/(x)(£J)  =  £;,„ 

3.  |D/"(x)(d)|  <  C/-'’|u|  for  i>  6  E\ 

4.  lD/-''(x)(r)|  ^  CX-''\v\  for  v  €  £“ 
for  ail  X  €  A  and  for  ail  0. 

Theorem  3.4.  [2].  Assume  A  is  a  hyperbolic  set  for  /.  For  every  e  >  0  there  is  a  ^  >  0 
so  that  every  5 -pseudo-orbit  in  A  can  be  e-shadowed. 

Theorem  3.4  is  a  direct  consequence  of  theorem  3.3  (see  [9]). 


4.  Computer-assisted  shadowing 

In  this  section  we  describe  a  computer  algorithm  which  uses  the  above  theorem  3.3 
to  verify  the  existence  of  true  orbits  of  a  dynamical  system  near  the  pseudo-orbit 
determined  by  a  numerical  computation.  Along  with  the  pseudo-orbit  being  computed, 
there  are  some  auxiliary  calculations  to  be  made  to  check  that  the  hypotheses  of  the 
theorem  are  satisfied.  Namely,  it  is  necessary  to  find  upper  bounds  for  the  constants 
B,  CSC  d,r„,t„,  and  finally  C„  and  D„.  We  next  describe  these  auxiliary  calculations, 
which  if  successful  provide  a  computer-assisted  proof  of  the  existence  of  a  true  orbit. 
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4.1.  CoHstruaioH  of  stable  and  unstable  frames 

The  algonthm  works  best  when  the  o-pseudo-fames  and 

ju., . are  chosen  to  approsimaieiy  encompass  the  staddc  and  unstable 

directions,  respectively,  for  the  dynamical  system  |/,}  at  the  particular  map  /,.  One  way 

to  accomplish  this  is  as  follows.  S^in  with  an  oitbonormal  set  . 1^}  of  vectors 

in  A"  chosen  arbitrarily,  inductively  define  the  oitbonormal  set  to  be 

the  computed  results  of  applying  the  technique  of  Gram-Sdunidt  orthogonsdization. 

followed  by  normalization,  to  the  set  !i>/.(x,)u,, . Because  of  computer 

round-off.  these  computations  will  be  only  apiHOximate.  which  is  not  important 

For  whidi  S  is  {u,, . ^  ^-pseudo-frame?  It  is  straightforward  to  find  a 

<5  for  which  both  parts  of  definition  3.2  are  satisfied.  Part  I  is  easily  checked  with 

the  computed  {u,, . ^uid  depends  on  the  residual  error  of  the  Gram-Schmidt 

orthogonalizatioa  In  most  cases  of  following  a  trajeaory  of  a  system  of  ordinary 
differential  equations,  the  a  will  be  determined  by  part  2  of  definition  3.2.  which 
depends  on  the  error  bound  of  the  ODE  solver  bang  used  to  follow  the  tangent  vectors 
along  the  pseudo-orbit 

The  frame  {s.i . is  defined  analogously.  B^n  with  an  arbitrary 

orthonormal  set  Giver:  {s,, . s^}  for  n  ^  S,  apply 

Gram-Schmidt  to  the  set  {D/^‘,(.x„_,).v„,.....D/^',(.x,_,)s^}.  The  stored  values  of 
the  resulting  computation  arc  by  definitioa 

The  calculation  of  esc  6^  where  0„  is  the  angle  between  S,  and  U„,  is  simple  if  the 
dimension  m  is  small  but  for  higher  dimensions  the  following  scheme  may  be  helpful. 

Define  to  be  the  m  x  m  matrix  whose  columns  are  {s„,,....s^,u„, . u^},  and  let 

B„  =  A~'.  Let  B'  be  the  m  X  m  matrix  whose  top  k  rows  are  the  same  as  those  of  B„ 
and  whose  bottom  /  rows  are  filled  with  zeros.  Let  B"  be  the  m  x  m  matrix  whose  top 
k  rows  are  the  filled  with  zeros  and  whose  bottom  /  rows  are  the  same  as  those  of  B„. 
Note  that  B  =  B!  -I-  B^ 

Now  define  S„  =  /1„B‘  and  L\  =  A^B".  It  is  clear  that  S„  and  are  projections 
onto  S„  and  U,,  respectively,  and  that 

s„  +  u„=^a„{BI,  +  b:)  =  i.. 

Further,  and  U„  are  the  unique  m  x  m  matrices  with  these  properties. 

It  is  a  standard  fact  that  csc0„  =  |S„|  =  |(/„|,  where  as  usual  we  use  the  Euclidean 
matrix  norm.  This  scheme  provides  a  computationally  stable  method  for  computing  a 
strict  upper  bound  on  csc0„.  which  is  necessary  for  bounding  the  C„  and  D„. 


4.2.  Calculation  of  r„  and  r„ 

We  have  defined  to  be  a  positive  number  that  bounds  the  growth  of  /„  in  the 
direction  S„  at  .x,.  That  is.  satisfies  |J„ji  $  r„|j|  for  vectors  y  in  S„.  Such  a  number 
is  impossible  to  find  by  measuring  |J„}|  on  a  general  basis  of  S„.  This  is  the  reason 
that  almost-orthogonal  frames  are  needed  in  the  calculation.  Lemma  4.1.  using  A  =J„ 
and  W  =  S„,  shows  how  to  find  an  upper  bound  on  r„  solely  using  information  about 
the  action  of  J„  on  the  almost-orthogonal  basis  of  S„.  Analogously,  i„  can  be  found 
by  using  lemma  4.1  with  A  =J~\  on  the  subspace  U„^|. 


Lemma  4.1.  Let  A  beanmxm  matrix  and  W  a  subspacc  of  R”  with  basis  {wp _ ^v^ }. 

Let  IV  be  the  m  x  Ic  matrix  with  columns  [H|,...,w^}.  Then 


max  I/li’l  ^ 

iew.iii=^i 
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when  the  right-hand  side  exists. 

Lemma  4.1  is  proved  in  section  5. 

4J.  Calculation  of  C,  and  D, 

Computing  and  D,  appears  simple  once  cscd„,  and  t„  are  known.  There  are 
two  mote  details,  however,  that  greatly  reduce  the  data  requirements  of  this  task.  In 
applications  of  this  algorithm,  it  is  typical  for  N.  the  number  of  points  in  the  pseudo¬ 
orbit.  to  be  of  the  order  of  several  million.  On  the  other  hand,  we  have  previously 

suggested  that  the  computation  of  the  stable  frame  {s„,, _ (and  therefore  6„) 

be  dotK  by  beginning  with  a  random  frame  at  n  =  iV.  and  applying  J~^  to  create 

frames  —  1 . 0.  To  avoid  the  problem  of  storing  ail  frames  simultaneously,  we 

suggest  building  Js,, . 'n  pieces  of  length  iV,  <  N.  For  example,  we  found 

.V,  =  5000  to  be  reasonable. 

The  idea  is  to  find  each  block  of  5(XK)  neariy-orthogonal  bases  by  stopping  after 
each  b!  'ck  of  5(X)0  points  in  the  pseudo-orbit,  finding  the  next  KXK)  points,  and  then 
applying  J~'  6(XX)  times  to  a  random  starting  orthogonal  basis  to  produce  stable 
directions,  and  then  go  on  to  the  next  block  of  SOOO.  In  all  cases  we  ha.e  tried,  the 
stable  frame  produced  this  way  satisfied  definition  3.2  within  the  prescribed  S. 

The  second  problem  is  deciding  whether  the  recurrence  relation  D„  stays  within  the 
bound  of  the  theorem,  given  that  it  is  defined  beginning  at  the  end  of  the  trajectory. 
The  following  simple  lemma  shows  how  to  verify  the  bound  on  D„  in  forward  time.  In 
short,  a  new  recurrence  relation  £„  is  defined  which  is  computed  in  forward  time.  The 
lemma  shows  how  to  tell  by  computing  E„  whether  D„  violates  a  given  bound. 

Lemma  4.2.  Let  Dy  =  0;  D„  =  be  a  recurrence  relation  for  n  =  0. . . . .  jV 

and  let  .-1  be  a  real  number.  Define  another  recurrence  relation  £„=/!; 

^n+i  -  min{(£„  —  a„)/b„,.4]  for  n  =  0 . .V.  If  £„  ^  0  for  n  =  0....,,V.  then 

D„  ^  .-1  for  M  --  0. . . . ,  .V . 

4.4.  Calculation  of  B 

The  calculation  of  B,  the  upper  bound  on  the  magnitudes  of  the  first  and  second 
partial  derivatives  of  the  /„,  is  normally  trivial  if  we  are  given  the  explicit  map.  In 
more  interesting  cases,  we  are  following  the  (possibly  time-dependent)  flow  of  a  system 
of  differential  equations,  and  need  bounds  on  the  derivatives  of  the  timc-/i  map  for 
step  size  h.  It  is  this  map  which  is  being  approximated  by  the  numerical  ODE  solver. 
To  this  end.  consider  the  first-order  system 

y  =  Fit,  y) 

where  y  is  a  vector  in  R”  and  t  denotes  the  independent  variable.  Define  g(t,s,r)  to 
be  the  value  of  the  solution  with  initial  condition  y(.s)  =  :  at  time  t.  Then  the  time-/i 
map  of  the  differential  equation  which  maps  the  value  at  time  to  the  value  at  time 
tg  -)-  h  is  given  by 


U.h(y)  =g(to  +  />''o.>)- 


The  following  lemma  establishes  upper  bounds  on  the  partial  derivatives  of  the  m 
component  functions  of  /  =  /,^j,  = 
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Lemma  4.3. 


1.  Define  £,=  max 

5f, 

.  Then  max 

cf, 

£yj 

CVj 

2.  Define  £-,  =  max 

W7 

o-F, 

.  Then  max 

f, 

I.JM 

cyfVk 

cyf\\ 

The  proof  is  an  exercise  in  using  the  Gronwall  inequality  (see  for  example  lemma 
4.1  of  [8])  on  the  first  and  second  variational  equations  of  the  system. 


4.5.  Quadrature  method 

To  apply  theorem  3.3  to  a  differential  equation  such  as  the  forced  damped  pendulum, 
we  need  a  quadrature  method  which  has  high  accuracy,  and  which  has  an  explicit  error 
formula.  The  former  is  necessary  to  allow  application  of  the  theorem  with  a  reasonably 
small  S  (and  therefore  a  long  shadowing  timel.  The  latter  is  necessary  to  assure  that 
we  have  a  rigorous  bound  on  6. 

The  simplest  method  that  satisfies  these  two  criteria  is  the  Taylor  method.  The 
formula  for  the  one-step  error  is  explicit,  being  essentially  the  Taylor  remainder. 
However,  the  major  difficulty  with  implementation  of  the  Taylor  methoos  in  general 
is  that  they  require  explicit  differentiation  of  the  right-hand  side  of  the  differential 
equation.  Thus,  applying  the  seventh-order  Taylor  method  to  the  differential  equation 

y-l-ay-l-siny  =  hcost  (1) 

evidently  requires  differentiating  the  differential  equation  five  times.  The  formulae  fill 
a  few  pages. 

Fortunately,  there  is  a  trick  which  allows  application  of  the  Taylor  method  as 
an  ODE  solver  without  doing  the  symbolic  calculation  of  higher  derivatives  of  the 
differential  equation.  We  illustrate  the  trick  in  terms  of  equation  (1).  Set  r,  =  siny  and 
r,  =  cos  y.  Then 

=(cosy)y  =  r,y 
r,  =  (-siny)y  =  -z,y. 

Now  given  a  point  (y,  y)  in  phase  space  at  time  f,  we  show  how  to  calculate  the  higher 
derivatives  of  y  at  time  t.  First  of  all,  we  can  calculate  r,,;,  ^^om  the  definitions  and  y 
from  equation  ( 1 ).  Then,  for  i  ^  1 ,  we  recursively  calculate 


y(i+2)  _  +/j(C0Sf)''’ 


using  the  differential  equation  and  the  product  rule  of  Leibniz.  The  higher  derivatives  of 
y  at  time  t  are  therefore  known,  so  we  can  apply  the  Taylor  method  of  arbitrary  order 
with  no  symbolic  calculation  beforehand.  A  similar  trick  applies  to  the  variational 
equation  of  (1).  We  applied  the  seventh-order  Taylor  method  to  follow  solutions  of 
both  the  differential  equation  and  the  variational  equation.  The  latter  is  necessary  for 
calculating  a  rigorous  ^-pseudo-frame  for  the  computer-generated  trajectory. 
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5.  Examples 

As  a  first  example,  consider  the  Henon  map 
f(x,y)  =  {a- X-  +  by,  x) 

of  the  plane.  For  parameter  values  a  =  lA,  b  -  0.3,  this  map  has  an  apparently  chaotic 
orbit.  Using  the  method  described  above,  a  computer-generated  ^-pseudo-orbit  with 
initial  condition  (0,0)  and  S  =  lO"'"*  was  found  to  have  a  true  orbit  within  10“’  for 
over  one  million  iterates.  Similar  statements  apply  for  other  initial  conditions,  and  for 
other  parameter  values. 

The  pseudo-orbits  generated  by  our  computer  satisfied  |.x|  ^  2,  |y|  ^  2  in  every 
case.  In  this  range,  the  magnitudes  of  the  first  partial  derivatives  of  /  =  if  \,f 2)  and 
the  easily-computed  inverse  /  “‘  =  (g|,g2)  are  bounded  above  by  4.  The  magnitudes  of 
the  second  partial  derivatives  are  bounded  by  2.  Therefore  we  used  m  =  2,  B  =  4  in 
the  hypotheses  of  theorem  3.3. 

This  map  was  originally  shadowed  in  [6],  and  similar  results  were  reported.  In  that 
paper,  a  different  approach  was  taken,  which  uses  96-b-*  arithmetic  (machine-epsilon  = 
10"**)  to  verify  shadowing  of  a  ^-pseudo-orbit  r  Icula  a  in  48-bit  arithmetic,  i.e.  with 
(5  =  10~‘‘‘.  The  method  of  the  present  paper  does  not  require  such  higher  precision  for 
this  map. 

This  point  becomes  especially  relevant  when  systems  are  studied  that  are  inherently 
more  difficult  to  shadow.  Consider  the  forced  damped  pendulum,  which  satisfies  the 
.itfcrential  equation 

y  4- ay  +siny  =  bcosf. 

To  achieve  good  shadowing  results  for  this  differential  equation  we  needed  to  generate 
a  ^-pseudo-trajectory  with  5  =  10"'*.  We  accomplish  this  by  using  a  seventh-order 
one-step  quadrature  method  with  an  explicit  truncation  error  formula,  using  a  step 
size  of  b  =  71/ 1000.  The  implementation  details  of  the  quadrature  method  are  given  in 
section  4.5.  The  fact  that  the  quadrature  error  formula  is  explicit  is  critical.  Without  it 
we  could  not  get  a  rigorous  bound  on  <5. 

For  the  forced  damped  pendulum  with  parameters  a  =  0.2  and  b  =  2.4,  there  is  an 
apparently  chaotic  trajectory  with  initial  conditions  y(0)  =  j)(0)  =  0.  Using  theorem 
3.3,  we  proved  the  existence  of  a  true  trajectory  within  10"’  of  the  computer-generated 
trajectory  for  time  t  ranging  from  0  to  IO’tt,  This  trajectory  corresponds  to  10’  time 
steps  of  the  ODE  solver.  Again,  there  are  similar  results  for  other  initial  conditions,  and 
other  values  of  a  and  b 

The  maps  /„  used  ii  rem  3.3  were  the  time-/i  maps  of  the  non-autonomous 
differential  equation,  where  ,,  —  71/ 1000.  The  derivation  of  B  for  the  forced  damped 
•’duluni  uses  lemma  4.3.  Write  the  pendulum  equation  as  a  first-order  system.  Then 
■  in  lemma  4  3  is 


F(t,>'i.>’2)  =  0’2>'"S>n.Vi  -uy,  -t-bcosf). 

It  is  easy  to  check  that  the  first  and  second  partial  derivatives  of  F  with  respect  to 
y,  and  y2  are  bounded  in  absolute  value  by  1,  so  that  £,  =  £2  =  Lemma  4.3  says 
that  B  =  max{2,e’'',4/ie®''}.  Since  h  —  10"'*,  we  use  B  =  2,m  =  2  in  the  hypotheses  of 
theorem  3.3.  Note  that  the  inverse  of  a  time-/i  map  is  a  time-minus  h’  map,  so  that 
the  same  B  works  for  /"'. 
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6.  Proof  of  theorem 


The  convention  in  this  section,  as  in  the  entire  paper,  is  that  all  vector  and  matrix 
norms  are  /’  (Euclidean)  norms.  The  norm  of  an  w  x  m  matrix  A  is  defined  in  terms 
of  the  vector  norm,  as  follows: 

|/4|  =  max  |/4t)|. 

r6R",|i'l=l 

It  follows  from  the  definitions  that  i/l|  =  ^/aiA^A),  where  ff(fl)  denotes  the 
maximum  absolute  value  of  the  eigenvalues  of  the  symmetric  matrix  B. 

Lemma  6  1.  If  /I  is  an  m  x  m  matrix  whose  entries  are  at  most  ^  in  absolute  value, 
then  |/1|  <  md. 

Proof  i  4|  Mlp,  where  \A\]:  =  £"=1  DLi 

Lemma  6.2.  If  is  an  m  x  )c  matrix  and  .v  =  Wy,  then 

When  the  right-hand  side  exists. 


Proof. 

|y|2  =  + 

^  |/-  W'^If'||y|-  +  |x|^ 

Proof  of  lemma  4.1.  Let  .x  e  W.  Then  .v  =  IV\\  and  Ax  =  AWy.  By  lemma  6.2, 

1 


max  l.Txl- =  —  ,, 

vl  =  l,x6W  1  -  Ilf'*  ir  -  /|  ,6R‘,IM  =  I 


max 


and 


max  \.4Wv\-=  max  v'^(AWfAWy  =  a((AlVfAlV). 

>'6R‘,lyl=l  ■  )’€R*.lvl=l’ 


Lemma  6.3.  Let  {r„| . ^  ^-pseudo-frame  for  the  matrix  J,  where 

S  <  3/(4fc).  Let  A„  be  the  matrix  with  columns  {i’„| . For  each  v  e  range 

Aq  there  is  a  w  €  range  A^  such  that  \Jv  —  w(  ^  2\/fe5 |i’|. 

ProoJ.  Let  r  =  CjUo,;  that  is.  r  =  /IqI'.  Define  w  =  A^c  =  Then 


|Ju  -  vvj  = 


1=1 


(5  ,5V^|c| 


1=1 


d\/k\t 


yjl  -  Mj/lo  -  /I 
where  the  last  line  follows  from  lemma  6.2. 


=  ^  2(5\/fcki 


□ 
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The  next  two  lemmas  refer  to  a  C^-map  /  which  maps  a  convex  subset  S  of  R!”  to 
R'".-  Define  B,  (respectively,  B,)  to  be  an  upper  bound  on  the  magnitude  of  all  first 
(respectively,  second)  partial  derivatives  of  all  component  functions  of  /  on  S.  Assume 
that  .X  and  x  +  h  lie  in  S. 

Lemma  6.4. 

1.  |/(x  +  /i)-/(x)|^  mB,|/i|. 

2.  |D/(x  +  h)  -  Df{x)\  ^  my/mB.H 

Proof.  For  a  scalar  function  g, 


|g(x  +  /i)-s(x)|  <  max 


££. 

cx, 


^  Ihlv^max 

r-i 


£g 

ox, 


Applying  this  to  each  entry  of  the  vector  /,  and  the  matrix  Df,  respectively,  one  gets 
the  stated  estimates. 


Lemma  6.5. 


Proof.  Each  component  g  of  /  satisfies 
|g(x +/|)  -  ,g(x)  -  0/(v)/i|  ^ 

from  which  the  result  follows  easily.  □ 

Now  assume  that  (.v„|,.  and  !i(„| . are  di-pseudo-  frames  for  the 

dynamical  system  {J„}  on  R'",,  where  k  + 1  =  m.  Let  B  be  an  upper  bound  for  the 
magnitude  of  all  entries  of  the  J„.  Let  S„  and  U„  be  the  subspaces  spanned  by  the 
moving  frames  and  let  S„  and  U„  be  the  projections  onto  the  subspaces  such  that 
S„  +  t/„  =  /. 


Lemma  6  6. 

1.  For  11  e  U„, 

(a)  ^  2/n'''’(5|S„^il|u|,and 

(b)  ^  2m^'"B,5iS„_|i!«|. 

2.  For  s  e  S„, 

(a)  2/n‘''-(5!t/„^,l!s|,  and 

(b)  2m^‘^■BS\U,_^l\s\. 
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Proof  To  prove  1,  we  use  the  fact  that  {m„, . ^ -pseudo-frame  for 

If  we  are  given  u  €  U„,  there  is  w  €  U„+|  such  that  \J„u  —  w|  <  2y/iS\u\,  by  lemma  6.3. 

~  1^11+1‘^it*^  “  ^n+l^  "i"  ^n+l'''l 

^  2>/m^|S,+,llu|. 

Secondly,  we  use  the  fact  that  {u„, . Un/lilLo  ’*  *  6mfl-pseudo-framc  for 

Given  u  e  U„,  there  is  w  €  U„_.  such  that  -  w|  <  2\//mB^ |u|. 

=  |S„_,  J,-\u  -  S„_,w  +  V,vv| 

=  -  S„_,vv| 


Part  2  is  similar. 

Proof  oj  theorem  3.3.  For  each  0  ^  n  <  M,  is  a  C^-difTeomorphism.  Let 

{.vJiJLo  be  a  d -pseudo-orbit  of  the  dynamical  system  {/„}.  Define  J„  -  Df(x^).  Let  B^ 
(respectively,  flj)  be  an  upper  bound  for  the  absolute  value  of  the  first  (respectively, 
second)  partial  derivatives  of  the  component  functions  of  and  /"'  on  the  union  of 
balls  of  radius  <5*^^  centred  at  .x„  for  n  =0,...,N.  Set  B  =  max{2, positive 

integers /c+/  =  m,  let  {s„,,....s„JiJLo  (respectively,  {«„, . u„(}!!l.o)  be  a  6-pseudo-frame 

for  {J~'\  (respectively,  {J„})  such  that  sp®”*  for  each  n. 

Define  S„  =  span{s„, . s„*},  U,  =  span{M„, . u„,},  and  define  d„  to  be  the  angle 

between  S„  and  U„.  Let  S„  (respectively,  U„)  be  the  (unique)  projection  onto  S„ 
(respectively,  U„)  such  that  S„  +  =  1.  Recall  that  |S„1  =  |l/„|  =  csc0„.  Let  and  t„ 

be  numbers  satisfying 


^  Myl  for  y  €  S„ 

^  f„lr|  for  :  6  U„^,. 


Define  v®  =  =  r'y  =  0  for  i  =  0, 1, 2 . 

and  define 

yn=Snif«-l^-<+Jn-\yn-\) 

for  n  =  1,.. 

.,N. 

(2) 

for  n  =  0, . . 

...N  -  1. 

(3) 

-C  =  <+.v;+-’i 

for  n  =  0, . . 

.,N. 

(4) 

The  sequence  's  the  result  of  applying  the  refinement  technique  i  times  to  the 

original  pseudo-orbit  Define  p  by  S~^  =  m^^'B^.  Let  Cq  =0,C„  =  |5„|-l-r„_,C„_| 

for  n>0.  Similarly,  let  Dy  =  0,£>„  =  \U„\  + ^OT  n  <  N. 


976 


T  Sauer  and  J  A  Yorke 


Lemma  6.7.  Assume  that  C„  <  and  D„  <  for  n  =  0 . N.  Then  for 

n  =sO,...,N  and  i  ^  0: 

(a)  |>-;|  ^  2-'dC„  ^  2-'<5'’+'/2 

(b)  141  2-'SD„  <  2-‘<5'’+'/2 

(c)  2'-'<5'’+'/2 

(d)  |x'-^'-x0|< 

Proo/  Statement  (d)  follows  from  (c).  Statements  (a),  (b)  and  (c)  are  proved  by  double 
induction  on  i  and  n.  If  i  =  0; 

(a)  |)'ol  =  0.  and  for  n  >  0, 

\yl\  <  IS,l^  +r„_, !>•«_, 1  <  |S„1<5  +r„_,<5C„_,  <  C„5. 


(b)  |;“|  <  0,(5,  by  reasoning  similar  to  (a). 

(c)  |xi  -  x“|  ^  lySl  + 12“|  <  <S(C,  +  Df,)  ^  626^-'''^  = 

Now  we  assume  that  (a)  holds  for  /  -  I,  and  prove  it  for  case  i.  We  induct  on  n. 
The  n-Q  case  is  trivial,  since  lyil  =  O'  Assume  that  (a)  holds  for  the  case  /, n  -  1  and 
prove  it  for  i.n: 


yh  -  s„(/„_i(xi,_,)  -  x|,  +4_, 

=  s„(/„_,(x;,.,)  -4_,(x7J,)  +/,_,(x:,-',) 

-C'  -4"'  -C  +4-i4-i) 

=  ,(.4_i)  -  /n-i(C'i)  -  D/«-i(-C'i)K-i  -  -Cl) 

+(D/„_,(Ci)  -4-.)(C,  +Ci) +CiCi  +4-i>';-ii 

where  we  have  used  the  facts  that  S„(4“‘)  =0  and 

SJ<'  +4-'  -/«-i(-C))  =  s„(4_,C.) 

by  the  definition  of  y‘~\ 

We  will  bound  the  Euclidean  norm  of  each  of  the  four  terms  of  the  last  sum 
separately. 

1. 


-/„_,(xrJ,)  -D/„_,(xrJ,)(xU.  -.Ci))l^  ISJ 


"ICi 


4-il 


^  |S„152-'-^  325,2- 
^  |5J<52— ' 


since  m  ^  2,  B  ^  2  implies  that  S~^'’  >  m^B*  =  325m^^*  {m^^^B^)/32  >  32Bm^^^. 
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2. 


<  |SJ(52— ^ 


^  |SJ<52 


-1-2 


since  6~^’’  > 
3. 


2|S„lVm<5lC'' 


=  \  f>d^^\/m  2~'~^(5 
<  2—^(5 


since  <5"^'’  >  \6,/m. 

4. 


^  r,.,W_,i+2-'5 


since  6~'’‘  >  Sm^  'B. 

Adding  up  the  four  bounds  we  have 

|y;i^  4|SJ^2— '+V,1>;_,1 
^  |S,|<J2-‘+v,2-5C„_, 

=  C,<52-. 

This  proves  (a)  for  the  case  i.  The  proof  of  (b)  is  similar,  except  that  we  use  descending 
induction  on  n.  The  n  =  N  initial  case  of  (b)  is  trivial,  since  |z}^|  =  0.  Finally,  (c)  is  a 
simple  consequence  of  (a)  and  (b).  □ 

Lemma  6.7  shows  that  for  each  n,  yj,  ->0,21,  -*  0,  and  that  {xJ,}*o  is  a  Cauchy 
sequence.  Therefore  .x'„  converges  to  some  iv„  in  R”.  The  sequence  is  ‘he  limit 

of  the  refinement  process  applied  to  Moreover,  lemma  6.7  (d)  implies  that 

We  will  complete  this  section  by  showing  that  for  n  =  0,...,N  -  1, 

so  that  the  {w„}  represents  a  true  shadowing  orbit  of  {x„}.  According  to  equations  (2) 
and  (3), 


5„+i(/„K)  -  =0 


(5) 
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and 

(6) 

for  n  =  0 . A'  -  1.  Furthermore,  we  have 


I/„(W„)  -  W„^,|  ^  |/,{w„)  -  /,(x„)|  +  l/„(x,)  -  x„^,l  +  |x,^,  -  W„^,|  I 

^  mB^\w„-x„\+S I 
<  (mfl,  +1)4(5'’+'^^ 


^  4(mB  +  n\ 

^  ^  mi/232  J 

'  1  4(4  + 1)\ 

^  1 

2«2=  j 

A  similar  calculation  shows  that 

1 

Secondly,  corollary  to  this  calculation  are  the  facts  that 

1 

and 

Therefore  )„(w„)  and  /''(w,^,)  are  within  the  balls  around  .x,^,,x,,  respectively,  for 

which  the  lemmas  6.4-6.5  concerning  growth  bounds  on  f„  apply.  ] 

Lemma  6.8.  The  sequence  is  an  orbit  of  the  dynamical  system  {/„}.  That  is. 

/„K)  =  “'n+i  for"  =  0 . I 

Proof.  Equation  (6)  says  that  U„lw„  /"‘(w^^.,))  =0.  Since  S,  +  l/„  =  /,  w„-/-'(w„+,) 

belongs  to  the  subspace  S„.  We  evaluate  ^"^0  ways.  First,  - 

using  the  fact  that  +  t/„+|  =  /,  I 

^  UniK  I 


where  the  last  inequality  uses  lemma  6.6. 
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On  the  other  hand, 

Jn(^n  -  =/n(*V,)  “  -  (/„(w„)  -  W„^.,  -  D/„{w„)(w„  -  /„"'{w„+l))) 

Since  .)  =  0  by  equation  (5),  we  have 

<  -  /7'(w„+i)l’  +  -  wj|w„  -  /7'(w„+i)l 

Putting  the  two  inequalities  together,  we  have  that  either  w,  =  /„"'(w„*|),  in  which 
case  we  are  done,  or  else 

/WOj 

where  we  use  the  bound  on  |S,+,|  and  This  inequality  implies  that 

5-"  ^  i 

V2  N/iOm  m5/2BV 

< 

since  m  ^  2,  B  ^  2.  This  contradicts  the  assumption  (i"'’  =  m^  ’B*.  Therefore 
‘v,  =  for  n  =0 . .V  -  1.  □ 
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Abstract.  In  dynamical  systems  examples  are  common  in  wliich  there  are  regions 
containing  chaotic  sets  that  are  not  attractors,  e.g.  systems  with  horseshoes  have 
such  regions.  In  such  dynamical  systems  one  will  observe  chaotic  transients.  An 
important  problem  is  the  'Dynamical  Restraint  Problem';  given  a  region  that  contains 
a  chaotic  set  but  contains  no  attractor,  find  a  chaotic  trajectory  numerically  that 
remains  in  the  region  for  an  arbitrarily  long  period  of  time. 

We  present  two  procedures  (‘PIM  triple  procedures’)  for  finding  trajectories  which 
stay  extremely  close  to  such  chaotic  sets  for  arbitrarily  long  periods  of  time. 


1.  Introduction 

Studying  dynamical  systems,  one  often  observes  transient  chaotic  behaviour, 
apparently  due  to  the  presence  of  horseshoes.  For  example,  for  suitably  chosen 
parameter  values,  the  Henon  map  has  an  attracting  period  orbit  with  period  S  and 
also  a  non-attracting  chaotic  set.  and  one  observes  that  the  duration  of  the  transient 
chaotic  behaviour  of  many  trajectories  is  rather  short  before  they  settle  down  on 
the  period  S  attractor.  Other  famous  examples  with  chaotic  transients  are:  the  Henon 
map  for  large  parameter  values  where  almost  all  trajectories  go  to  infinity  and  there 
is  a  bounded  non-attracting  invariant  set;  the  forced  damped  pendulum;  and  the 
Lorenz  equations  for  values  of  the  Rayleigh  number  below  the  standard  values  that 
have  a  chaotic  attractor.  Transient  chaos  is  also  present  whenever  there  is  a  fractal 
boundary  separating  the  basins  of  two  or  more  attractors. 

Let  M  be  a  smooth  n -dimensional  manifold  without  boundary,  and  let  F  be  a 
C^-diffeomorphism  from  M  to  itself.  We  denote  by  p  the  distance  function  on  M. 
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A  region  R  is  an  open  and  bounded  set  in  M,  We  say  a  region  f?  is  a  transient  region 
if  it  contains  no  attractor.  We  will  be  studying  these  regions  in  cases  where  the 
trajectory  through  almost  every  initial  point  eventually  leaves  the  region.  We  investi¬ 
gate  special  trajectories  that  remain  in  such  a  transient  region  for  all  positive  time. 
For  example,  the  horseshoe  is  usually  pictured  mapping  a  rectangle  to  a  horseshoe 
shape;  the  rectangle  is  a  transient  region.  The  great  majority  of  the  trajectories  of 
the  horseshoe  map  will  leave  the  region  after  a  few  iterates.  We  are  looking  for 
numerical  procedures  for  finding  chaotic  trajectories  that  stay  in  the  transient  region 
as  long  as  we  wish  to  compute  them  for  t  a  0.  The  main  problem  that  we  would 
like  to  address  is; 

The  dynamic  restraint  problem.  Find  a  (nonperiodic)  orbit  numerically  that  remains 
in  a  specified  transient  region  for  an  arbitrarily  long  period  of  time. 

The  above  problem  explicitly  concerns  numerical  (i.e.  computer)  procedures  of 
finite  precision.  It  leads  to  the  following  problem  where  it  is  assumed  all  computa¬ 
tion;  can  be  made  exactly. 

The  static  restraint  problem.  Find  an  initial  point  whose  orbit  stays  in  a  specified 
transient  region  for  an  arbitrarily  long  period  of  time. 

We  will  establish  a  procedure  (the  PIM  triple  procedure)  for  finding  points  whose 
orbits  will  stay  in  specified  regions  in  M  for  dynamical  systems  in  ideal  cases  that 
are  uniformly  saddle-hyperbolic  systems.  The  unstable  manifold  of  each  nonwander¬ 
ing  point  in  the  transient  region  is  assumed  to  be  one  dimensional. 

Let  R  be  a  transient  region  for  F.,  The  stable  set  S(R)  of  F  is  {.ve  R:  F"(x)6 
R  for  «  =0, !,  2, . . . };  the  unstable  set  U{R)  of  F  is  {.xe  R:  F'"(x)6  R  for  n  = 
0. 1, 2, . . . ).  The  set  of  points  x  for  which  F"(a(  is  in  R  for  all  integers  n  is  called 
the  invariant  set  Inv  ( R )  of  F  in  R.  that  is,  Inv  ( R )  =  S(  R )  n  L/(  R ).  A  component 
of  5(R)  (resp.,  U(R)),  which  contains  a  point  of  Inv  (R)  is  called  a  stable  (resp., 
unstable)  segment.  We  call  Inv  (R)  a  chaotic  saddle  when  it  includes  a  Cantor  set. 
We  assume  that  for  the  transient  region  '  the  set  Inv  (R)  is  nonempty. 

We  will  refer  to  R\S(R),  the  complement  of  the  stable  set  S{R)  in  the  transient 
region  R,  as  the  transient  set.  We  will  say  that  a  point  p  in  S(R)  is  accessible  from 
the  transient  set  R\S(R)  if  there  is  a  continuous  curve  K  ending  at  p  so  that  K\{p} 
is  the  transient  set  R\S{R).  For  uses  in  dynamics,  see  [COY]  and  [AY].  We 
wouiu  like  to  address  the  following  problem: 

Accessible  static  restraint  problem.  Given  a  segment  J  that  intersects  the  stable  set 
S(R)  transversally,  describe  a  procedure  for  finding  a  point  (in  7  nS(R))  which  is 
ac  'ble  (from  R\S(R)). 

Wc  will  establish  a  procedure  (the  Accessible  PIM  triple  procedure)  for  finding 
such  accessible  points  in  M  for  the  same  class  of  dynamical  systems  as  above. 

Both  our  procedures  are  based  on  our  presumed  ability  to  specify  an  initial  point 
p  and  compute  the  time  Tr(p)  its  trajectory  takes  to  escape  from  R.  In  the  PIM 
(Proper  Interior  Maximum)  triple  procedure,  we  seek  out  triples  of  points  a,  c,  and 
b  on  a  curve  segment  with  c  the  'interior’  point,  that  is,  c  is  between  a  and  b.  The 
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triples  are  selected  with  an  ‘interior  maximum’  of  the  escape  time,  which  means 
Tk(c)>  T^ia)  and  Tk(c)>  T,i(b).  We  then  look  for  new  triples  that  lie  in  the  a,  b 
segment  but  are  closer  together  and  so  are  ‘proper’.  The  most  challenging  cases  are 
those  in  which  the  average  escape  tin>r  is  short  so  that  the  transient  trajectories  of 
typical  points  in  R  do  not  come  close  to  the  unstable  chaotic  set. 

The  organisation  of  the  paper  is  as  follows.  In  §  2  we  present  the  PIM  triple 
procedure  and  the  Accessible  PIM  triple  procedure;  the  main  results  for  the  validity 
of  these  procedures  for  hyperbolic  systems  are  stated  precisely  in  §  3.  §  4  is  devoted 
to  the  proofs  of  the  results  in  §  3.  In  §  5,  we  will  discuss  the  associated  numerical 
procedures  (including  the  shadowing  of  the  numerical  orbits  by  real  orbits  of  the 
dynamical  system).  Finally  in  §  6,  we  will  explain  why  the  PIM  triple  methods  also 
can  be  used  for  basin  boundaries;  we  will  describe  how  the  results  carry  over  to 
higher  dimensional  systems;  and  we  also  will  argue  that  it  is  sufficient  to  assume 
that  F  is  of  class  C^. 


2.  The  procedures 

Let  the  manifold  M,  the  diffeomorphism  F,  and  the  transient  region  R  be  as  in  the 
introduction. 

The  escape  time  T^(x)  of  a  point  x  in  M  for  R  is  defined  by 

.  (min {n SO:  F’'(x)eR} 

^  loo  if  F''(x)e /?  for  all  n  so. 


For  the  example  of  the  horseshoe  map,  the  escape  time  function  has  the  following 
properties:  (1)  T(f{x)  =  oo  for  .x  on  a  Cantor  set  of  stable  segments;  (2)  if  a,  c,  and 
b  are  three  points  on  a  segment  L  of  an  unstable  segment  J  so  that:  (i)  c  is  between 
a  and  b  and  (ii)  Tr(c)>  max  {TrIo),  Tulb)),  then  the  segment  [a,b]jc:J  from  a 
to  b  intersects  the  stable  set  S(R).  These  properties  play  a  crucial  role  in  the  PIM 
triple  procedures,  and  lead  to  the  following  definitions.  Let  J  be  an  unstable  segment 
in  R.  Then  J  is  homeomorphic  to  an  interval,  and  we  may  assume  it  has  the  ordering 
of  an  interval.  The  notation  {a,  c,  b)  for  a  triple  means  that  a,  c,  and  b  lie  on  J  and 
c  is  between  a  and  b.  Let  L<=y  bt  a  ‘segment’,  that  is,  a  connected  subset  of  J. 
Assume  L  intersects  the  stable  set  S(R)  transversally,  and  let  (a,  c,  b)  be  a  triple 
on  L  Since  L  is  homeomorphic  to  an  interval  it  has  an  ordering.  We  assume  that 
the  ordering  on  J  (and  hence  on  L)  is  such  that  a<c<b\  and  for  points  .x  and  y 
in  J  we  write  [.x,>’]./  for  the  segment  on  J  joining  x  and  y.  The  triple  (a,  c,  b)  is 
called  an  Interior  Maximum  triple  if  Tft(c)>  max  {7^(0),  Tfilb)};  and  (a,c,b)  is 
called  a  Proper  Interior  Maximum  (PIM)  triple  on  L,  if  (a,c,b)  is  an  Interior 
Maximum  triple  and  at  least  one  of  the  points  a  and  b  is  in  tue  interior  of  L. 

For  each  f  >  0,  an  s-refinement  of  {a,  b}  (w.r.t.  J)  is  a  finite  set  of  points  a  =  go< 
g,  <  •  •  •  <  =  fe  in  [a,  b]j  such  that 


(e/2)  •  p([a,  hL)sp([gfc,  g^^.D^  e  •'p([a,  b]y) 
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for  all  fc.O£lc£N-l.  andan  e-refinemem  of  (a,c,b)  isao  e-refioement  of  la,  6} 
as  above  so  that  c  =  gt  for  some  k,l^k^N  —  l 

The  outline  of  the  PIM  triple  procedure  is  the  following.  Let  It  be  an  appropriately 
diosen  transient  region  for  F,  and  let  L  be  a  s^ment  on  an  unstable  s^meni  J 
(intersectinf  the  stable  set  transversally).  Let  r  >0  be  sufficiently  small.  Given  a 
PIM  triple  (a.,  c..  b„)  in  L,  staning  with  n  =0.  choose  some  e-refinement  P,  of  the 
triple  ia,,c„,bJi  in  [a.,  b.]^,  select  any  three  not  necessarily  consecutive  points 
from  P„  whidi  constitute  a  new  PIM  triple  (a.,.,,  c«.,.  b.>,)  on  [a„,  b.]y.  The  new 
triple  must  be  ‘proper*;  proper  here  means  [a.,., .  b..,,  ]>  is  a  proper  subset  of  [a„,  b.  ],. 
'Hie  condition  guaranteeing  the  e.xistence  of  such  a  PIM  triple  when  e  is  suffidentiy 
small,  will  be  described  in  §  3.  Note  that,  according  the  definition  of  PIM  triple. 
b,.,]j)^n  -0.5£)p((a„,  b.]y)..  Thus  the  nested  sequence  of  the  intervals 
b«]/}«sa  converges  to  a  point  which  we  will  call  a  PIM  Until  point.  The  e  above 
can  be  chosen  small  enough  that  it  is  independent  of  n.  We  will  show  that  under 
reasonable  conditions  the  orbit  of  the  PIM  limit  point  stays  in  the  transient  region 
R.  The  choice  of  the  PIM  triple  is  typically  not  unique  and  different  choices  will 
result  in  different  PIM  limit  poin’s.  This  ‘static*  problem's  solution  is  not  directly 
implemenuble  on  a  computer  because  computations  are  made  with  finite  predsion. 
but  it  lead  to  a  pradical  solution  of  the  uyna;>'ic  restraint  problem  as  discussed  in 
§5. 

The  idea  of  the  Accessible  PIM  triple  procedure  is  like  the  PIM  triple  procedure 
except  that  the  PIM  triples  ( a„,  c„,  b„)  are  seleaed  more  precisely  so  that  [a„, 
does  not  intersed  the  stable  set  S(/?)  for  all  n  >  A/  for  some  .V€N.  The  difficulty 
here  is  that  we  oily  compute  the  escape  times  of  the  grid  points  and  yet  we  must 
be  sure  that  {a„,  contains  no  points  of  5(1?).  We  must  guarantee  the  procedure 

will  succeed  if  oO  is  small  enough,  where  e  is  fi.xed,  depending  only  on  the 
diffeomorphism  and  region. 

Our  objective  is  to  describe  the  Accessible  PIM  triple  procedure  that  seleds  in  a 
unique  way  a  nested  sequence  of  PIM  triple  intervals  on  J  which  leads  to  an 
accessible  point  in  5(1?)  on  J.  The  accessible  point  p  in  Jo 5(1?)  that  we  will  find, 
will  be  accessible  using  the  curve  [r,  p],  for  some  r  in  7,  so  we  say  p  will  be  ‘accessed 
from  the  left’,  that  is  from  the  side  containing  r.  We  could  alternatively  have  chosen 
to  approach  from  the  right  and  we  would  expect  to  find  a  different  point. 

Given  an  e/3-refinement  P„  =  {.x, :  i  s  N{e)}  on  7  of  a  PIM  triple  (a„,  c„,  h„) 
in  7  with  a„  =  .Xo<x,  <•  •  =  Assuming  that  P„  includes  a  PIM  triple, 

then  we  chotse  the  next  PIM  triple  (a,*,,  c„*,,  b„+,)  in  P„  in  the  following  way: 

())  Select  to  be  the  leftmost  point  in  P„  such  that  it  is  the  right  point  of  a 
PIM  triple  in  P„ : 

(2)  Select  c„+,  to  be  the  adjacent  point  to  the  left  of  in  P„ ; 

(3)  fhe  systematic  choice  of  a„^.^  in  P„  is  the  following:  Let  M„  be  the  minimum 
value  of  {Tr(x,):  x,  e  P„,  x,  <  c„+|}.  We  write: 

a®+,  is  the  rightmost  point  of  {x,  e  P„ :  .x,  <  c„+,,  TrCx.)  =  M„}; 
a*+,  is  the  adjacent  point  to  the  right  of  a®+,  in  P„; 
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aU,  is  the  rightmost  point  of  {x.e  P.:  T«(x,)=  r*(a;,,)}. 

Case  ti).  If  either  M^<TK(a„)  or  A/,>min{r*(jr,):x,6P,}.  then  choose  a„„  = 
aZ-^t ;  otherwise. 

Case  (ii).  If  M„  =  Tg{a^)  and  P„  is  not  an  c-rciincment  of  ia„,c„^i,b„^,),  then 
choose  i  ~  a, ;  otherwise. 

Case  (iii).  If  M„  =  and  P,  is  an  r-reiinement  of  (a., c„,.,,  h„„),  and  if 

a”»,  > a,  or  =  c,„,  then  choose  o„»,  =  aZ^, ;  otherwise. 

Case  (iv).  If  M„=TK(a„)  and  P.  is  an  e-refinemcnt  of  (a„,  c„.,,  6„,,),  and  if 
aZ^i  =  a„  and  then  choose  a„^,  =  a'„^,. 

Repeatedly  applying  the  Accessible  PIM  triple  procedure  leads  to  an  accessible 
point  on  S(R). 

To  understand  rule  3,  notice  that  rules  I  and  2  imply  that  the  graph  of  Tn  is 
rather  simple  on  P„r^[a„,  c„^,]j,  namely,  Tr  is  monotonic  increasing  on  P„  between 
aZ^i  and  ,  and  is  non-increasing  on  P„  between  a.  and  a",.,  .  These  properties 
follow  from  the  fact  that  6„,.,  was  chosen  as  far  left  as  possible.  Wc  will  show  that 
after  the  first  few  iterates  r«(a„)  =  min  { Tii(.x,):  .x,  e  P„}. 

3.  Results 

In  §  2  we  presented  the  idea  of  the  procedure  for  finding  a  point  whose  orbit  stays 
in  the  transient  region.  In  this  description,  we  assumed  that  there  e.xists  an  c  >0 
for  which  every  c-refinementof  a  PIM  triple  includes  a  new  PIM  triple.  Furthermore, 
the  associated  curve  segment  from  a„,,  to  has  a  length  at  most  ( 1  -  e/2)  times 
the  length  of  the  previous  one  (from  a„  to  h„).  We  will  justify  these  concepts. 

Let  the  manifold  M  and  diffeomorphism  F  be  as  in  the  introduction.  .‘\  subset 
A  of  M  is  hyperbolic  if  it  is  closed  and  F-invariant  and  the  tangent  bundle  T^M 
splits  into  dF-invariant  subbundles  £'  and  £"  on  which  dF  is  uniformly  contracting 
and  uniformly  expanding  respectively.  A  hyperbolic  set  \  is  called  a  saddle-hyperbolic 
set  if  dim  .'"'si  and  dim  £“  ^  1.  We  will  call  a  region  R  a  saddle-hyperbolic  transient 
region  if  R  satisfies  all  the  following  conditions; 

(AI)  R  is  a  transient  region; 

(A2)  Hyperbolicity  property:  Inv(R)  is  a  nonempty  saddle-hyperbolic  set; 

(A3)  Boundary  property:  UIR)r\dR  is  mapped  outside  the  closure  of  R; 

(A4)  Intersection  properly:  each  nontrivial  component  y  of  U(R)  is  an  unstable 
segment,  that  is,  y  intersects  Inv  ( R);  note  that  such  a  segment  y  must  intersect 
5(R)  transversally. 

We  assume  throughout  that  dim  £"  =  1.  For  the  sake  of  simplicity,  we  issume 
that  n  =  2;  the  more  difficult  case  n  ^  3  will  be  discussed  in  §  6. 

For  a  saddle-hyperbolic  transient  region  R  and  e>0,  the  properties  ( Al)  and 
(A2)  imply  that  the  escape  time  of  almos'  every  point  on  an  unstable  segment  is 
finite.  (A  result  due  to  Bowen  and  Ruelle  [BR]  shows  that  5(R)  has  Lebesgue 
measure  zero.)  Hence,  one  may  assume  that  such  a  refinement  does  not  intersect 
the  stable  set  S(R). 
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If  |{  is  a  saddle-hyperboiic  transient  region,  then  the  escape  time  map  T„  restriaed 
to  an  unstable  segment  J^U(R)  has  the  following  two  properties,  which  follow 
from  Proposition  1  and  the  7- Jump  Lemma  below. 

(i)  All  the  points  in  a  chosen  segment  [a,  b]j  on  J  will  escape  from  R  if  and  only 
if  no  e-refinement  of  {a,  b]  includes  a  PIM  triple; 

(ii)  Tk  is  locally  constant  on  an  open  subset  of  full  measure  of  J.  and  if  T^ix)  <  oc 
and  X  is  a  point  of  discontinuity  of  then 

liminf  rR(y)  =  Tr(x)  and  limsup  Tr(>’)=  Tr(x)+ 1. 

Application.  The  objeaive  of  the  paper  is  to  present  procedures  which  enable  us  to 
obtain  numerical  trajeaories  lying  on  chaotic  saddles,  and  to  justify  that  these 
procedures  work  in  ideal  cases.  The  e.xampies  of  interest  will  rarely  satisfy  all  our 
hypotheses,  and  yet  we  observe  that  frequently  we  can  successfully  use  the  procedures 
to  obtain  pictures  of  lnv{R)  by  plotting  the  numerical  trajectory.  Consider  the 
following  example. 

Let  t...-  difleomorphism  F  acting  on  the  plane  be  given  by  > 

F{x,y)  =  {A-x'+ M- y,x). 

It  is  well  known  that  the  map  F  is  equivalent  under  a  linear  change  of  variables 
with  the  Henon  map.  We  choose  the  parameter  values  M  =  0.3,  and  A  =  3  in  figure 
1(a),  A  =  4.2  in  figure  1(b)  (and  figure  2)  and  A  =  2.0  in  figure  1(c).  Then  a  result 
due  to  Devaney  and  Nitecki  [DN]  implies  that  fl  =  {(x,y):  -3<x<3,  -3<y  <3} 
includes  the  nonwandering  set  of  F,  so  we  select  B  for  the  transient  region.  When 
A  =  4.2,  the  nonwandering  set  is  a  uniformly  hyperbolic  chaotic  saddle.  We  start 
the  numerical  procedure  with  the  horizontal  line  segment  with  y  =  1  extending  from 
the  left  side  of  B  to  the  right  side.  By  using  the  'PIM  triple  procedure’  we  obtain 
a  numerical  trajectory  consisting  of  tiny  intervals.  The  result  is  presented  in  figure  1. 

When  A  =  4.2,  the  region  B  is  a  saddle-hyperbolic  transient  region:  the  results 
due  to  Devaney  and  Nitecki  [DN]  imply  that  B  satisfies  the  conditions  i  A1)-(A4). 
When  A  =  3  we  do  not  know  if  condition  ( A2)  will  hold,  and  for  A  =  2.0  we  have 
a  non-fully  developed  horseshoe. 

In  figure  2  we  present  the  sets  U(B)  and  S{B)  for  A  =  4.2  (the  chaotic  saddle  is 
the  intersection  S(B}n  U(B)),  and  the  accessible  fixed  point  on  the  chaotic  saddle 
is  indicated  by  an  arrow. 

The  reader  is  referred  to  [NY]  for  other  applications  such  as  the  Lorenz  equations, 
the  pulsed  rotor  map,  and  the  forced  pendulum  equation. 

Rather  than  state  one  or  two  theorems  the  results  seem  best  stated  a  progression 
of  ideas:  (1)  PIM  triples  exist,  (2)  refinement  of  PIM  triples  incluoe  PIM  triples, 
and  (3)  the  resulting  sequence  of  PIM  triples  converge  to  a  desirable  point.  The 
special  case  of  accessible  PIM  triple  sequences  must  be  discussed  separately. 

From  now  on,  we  will  assume  that  i?  is  a  saddle-hyperbolic  transient  region  for 
F  with  dim  £“  =  1,  and  that  J<^  U{R)  denotes  an  unstable  segment.  That  implies 
that  both  ends  of  J  are  'n  the  boundary  of  the  transient  region  R.  We  know  by  the 
Intersection  assumption  that  J  intersects  the  stable  set  S(R).  Clearly,  this  property 
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Figure  1.  (a)  Numcncal  trajectory  obtained  by  the  PIM  inpic  procedure  for  the  Henon  map  m  ttic 
transient  region  -3< x,y<3,  and  parameter  values  A  =  3,  M  -0.3  (b)  Numencal  trajectory  obtained 
by  the  PIM  tnplc  procedure  for  the  Henon  map  in  the  transient  region  -3<Je,  y<3,  and  parameter 
values  -4=4  2,  Af  =0.3.  (c)  Numencal  trajectory  obtained  bv  the  PIM  triple  procedure  for  the  Henon 
map  in  the  transient  region  -3<  x,y  <3,  and  paiamctcr  values  -4  =  2  0,  M  -  0  3. 
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Figure  l — continued. 

will  not  hold  for  each  subsegment  L  of  J,  since  J  r\S(R)\s  nowhere  dense  in  J  and 
one  can  choose  the  segment  L  lying  entirely  m  the  complement  of  J  Our 

first  result  ‘PIM  Existence  Proposition'  characterizes  the  segments  intersecting  the 
stable  set  S(R). 

Proposition  1..  (PIM  existence.)  Let  L  =  [a,b]j  be  a  segment  in  J.  The  following 
statements  are  equivalent: 

(i)  there  exists  e>0  such  that  every  e-refinement  of  {a,  b}  includes  a  PIM  triple; 

(ii)  L  contains  a  point  of  Inv  (R)  in  its  interior. 

In  the  PIM  Existence  Proposition  the  segment  L  can  be  chosen  so  that  it  intersects 
‘-'i  R)  only  at  points  extremely  close  to  one  of  the  end  points  of  L  and  so  e  must 
;  extremely  small,  so  e  depends  on  the  choice  of  L.  However,  the  PIM  Refinement 
Proposition,  stated  below,  shows  that  a  single  e  (depending  on  F  and  R)  can  be 
used,  once  we  have  found  our  first  PIM  triple.  One  might  expect  that  our  assumptions 
of  uniform  hyperbolicity  would  imply  that  the  uniformity  of  e  would  be  an  easy 
corollary.  In  fact,  the  existence  of  an  e  for  each  PIM  triple  is  much  easier  than  e 
can  be  chosen  uniformly,  and  this  uniformity  is  essential  for  the  PIM  triple  pro¬ 
cedures.  In  principle  it  can  be  difficult  to  find  the  first  PIM  triple  if  the  initial  interval 
L  is  chosen  badly. 

Proposition  2.  (PIM  refinement.)  There  exists  e>0  (depending  on  F and  R)  such 


Chaotic  saddle  hyperbolic  sets 


197 


Figurb  2.  The  stable  and  the  unstable  manifold  for  the  hxed  point  at  approx.  1 1  729, 1  7291  for  the 
Henon  map  in  the  transient  region  -}<x,y<  3,  and  parameter  values  A  =  4.2,  M  =  0.3  The  accessible 
fixed  point  on  the  chaotic  saddle  is  indicated  by  an  arrow. 

that  there  is  a  PIM  triple  in  each  e-refinement  in  J  of  each  Interior  Maximum  triple 
in  y.  for  every  unstable  segment  J  <=■  U{R). 

The  next  result  deals  with  the  convergence  of  the  sequence  of  nested  PIM  triple 
segments  [a„+.|,  h„+i]j  c  [a„,  b„]j  on  J,  in  other  words,  the  PIM  triple  procedure  is 
valid.  A  sequence  of  PIM  triples  {(a„,  c„,  h„)}n^o  on  J  is  called  a  PIM  triple  sequence 
if  (a„+,,  b„^^)  is  in  an  e-refinement  of  the  Interior  Maximum  triple  (a„,  c„,  b„) 

for  all  n.  We  say  c„,  b„)}„^„  is  the  accessible  PIM  triple  sequence  if  {a„,  c„,  b„) 
is  selected  using  the  Accessible  PIM  triple  procedure  for  all  n. 

Proposition  3.  (PIM  convergence.)  Let  e>0  be  as  in  Proposition  2.  Every  sequence 
of  nested  segments  {[«„,  that  is  associated  with  the  PIM  triple  sequence 

{{a„,  c„,  on  J,  converges  to  a  point  on  SiR). 

The  next  resc't  is  the  key  in  proving  that  the  ‘Accessible  PIM  triple  procedure’ 
is  valid. 

Proposition  4  (Accessible  PIM  Refinement.)  Let  e>0  be  as  in  Proposition  2.  Let 
{(a„,  c„,  b„)}ni:o  ttn  Accessible  PIM  trtple  sequence  on  J.  Then  there  exists  integer 
A/  2:0  such  that  [a„,a„+i]j  does  not  intersect  S(R)  for  every  n2.  N. 

Recall  that  a  nested  sequence  of  PIM  triple  intervals  obtained  from  e-refinements 
will  converge  to  a  PIM  limn  point  on  S{R).  Note  that  the  PIM  limit  point  of  the 
PIM  triple  intervals  associated  with  PIM  triples  in  Proposition  4  is  an  accessible 
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point  on  S{R).  The  next  result  implies  that  the  Accessible  PIM  triple  procedure  is 
valid. 

Proposition  5.  (Accessible  PIM  convergence.)  Let  e>0  be  as  in  Proposition  2.  If 
the  PIM  triple  sequence  {(a„,  c„,  b„)}„£0  Proposition  3  is  an  accessible  PIM  triple 
sequence,  then  the  sequence  of  nested  segments  {[a„,  b„]j}„ao  on  J,  converges  to  an 
accessible  point  on  S{R). 

4.  Proofs 

4.1.  Preliminaries 

We  assume  that  is  a  saddle-hyperbolic  region  for  the  diffeomorphism  F.  By 
Smale's  ‘Spectral  Decomposition  Theorem'  [S]  we  know  that  we  can  decompose 
the  nonwandering  set  fl  into  a  finite  collection  of  disjoint  closed  invanant  subsets 
and  on  each  of  these  subsets  F  has  a  dense  orbit;  these  maximal  invariant  subsets 
of  fi  appearing  in  the  decomposition  are  called  the  basic  sets  (see  e.g.  [Ni]  and 
[GH]  for  the  definitions  and  several  properties  of  uniformly  hyperbolic  systems). 
From  now  on,  let  F  denote  basic  set  of  F.  From  the  definition  of  Inv  (R)  it  follows 
immediately  that  either  rclnv(R)  or  rnInv(R)  =  0.  This  implies  that  we  can 
decompose  Inv  (R)  into  finitely  many  basic  sets.  Note  that  ‘Fn  Inv  (R)  =  0’  does 
not  imply  ‘Fn  R  =  0’,  and  ‘Fn  R  5^  0’  does  not  imply  ‘Fn  Inv  (R)  0‘. 

Recall  that  for  zefl  the  stable  manifold  W*(z)  (resp.  unstable  manifold  1V"(2)) 
of  z  is  the  set  of  points  X  for  which  p(F''(z),  F"(x))-*0(resp.  p(F''’(z),  F"''(x))-*0) 
as  M-*oo;  the  local  stable  manifold  W’odz)  (resp.  the  local  unstable  manifold 
W'loci-))  of  z  of  size  )3  is  the  set  of  points  x  in  W‘{:)  (resp.  W“(z))  so  that  p(F”{z), 
F''(x)):£/3  (resp.  F”"(x))s/3)  for  all  integers  nsO,  where  /3>0.  When 

the  stable  or  unstable  manifold  is  a  curve,  we  write  W';^j(;)  and  lV!oc(z)  for  the 
two  components  of  W'J^,.(z)\{r},  where  <t  is  either  5  or  u. 

We  will  call  F  a  trivial  basic  set  if  F  consists  of  one  periodic  orbit,  and  we  call 
F  a  nontrivial  basic  set  if  F  includes  more  than  one  periodic  orbit.  Assume  that  F 
is  nontrivial,  we  call  F  periodic  if  there  exists  m  6  N  such  that  F""  has  no  dense  orbit 
on  F,  and  we  call  F  nonperiodic  if  it  is  not  periodic.  The  following  results  4.1,  4.2, 
and  4.4  are  reformulated  from  [NP]  and  [PT]. 

Proposition  4.1.  There  exists  finite  sets  P,  P\  and  P“  of  periodic  points,  P=  P'  u  P“, 
such  that  for  all  X  e  Inv  { R): 

(1)  If  X  is  not  a  limit  point  of  both  W“oc(x)nn  and  wro"(x)nn,  then  x  is  in  W"(  p) 
for  some  p  6  P". 

(2)  Ifx  is  not  a  limit  point  of  both  H  and  Wi~fx)n  fl,  then  x  e  W“(p)  for 

some  pe  P\ 

Proof  For  a  proof,  see  Newhouse  and  Palis  [NP]. 

Proposition  4.2.  Let  P*  and  P"  be  as  in  Proposition  4.1.  Let  T  be  a  nontrivial 
nonperiodic  basic  set  in  Inv(R).  Then  there  exist  finitely  many  disjoint  regions  R, 
being  dijfeomorphic  images  of  the  square  B  =  [-1,  1]  x  [-1,  l],  say  R,  =  g,(B),  l^i^ 
N  for  some  NeM,  such  that  :  (1)  F  n  R,  ^  0  for  all  i-,  (2)  F  c  R, ;  (3)  F(3jR,)c 
U,^|5,R;andF"'(5u/?.)'=U,'l,  duR,whered,R,  =  g,({(x,y):  |x|=  1,  -1  1})  resp. 
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=  ~l^JC^l,|y|  =  l})  are  segments  in  the  stable  set  IV’(P“)  resp. 

the  unstable  set  W“(P*). 

Proof.  For  a  proof,  see  Palis  and  Takens  [PT]. 

Remark.  The  intersection  of  F  with  the  union  of  the  regions  in  Proposition  4.2  is  a 
Markov  partition  for  F,  see  Bowen  [B]  for  the  notion  of  Markov  partition. 

Proposition  4.3,  Let  P“  be  as  in  Proposition  4.1.  Then  we  have  xeS(R)  is  accessible 
if  and  only  if  xe  W’{p)  for  some  p  e  P“. 

Proof  Apply  the  Propositions  4.1  and  4.2. 

From  now  on,  let  2  6  Fc  Inv  (P)  be  fixed,  and  let  /“  c  W‘‘(z)  be  a  segment  such 
that  /“  crosses  each  region  R^  at  least  once,  where  Pn,  1  ^  k  ^  A/,  is  as  in  Proposition 
4.2.  Palis  and  Takens  [PT]  have  shown  that  there  exist  finitely  many  disjoint  regions 
denoted  P;(/“)  in  R,  that  have  the  same  properties  as  the  P,'s  such  that  /“ 
crosses  each  Pj(/“)  exactly  once,  1  A/(/“),  for  some  N{r)eN.  Therefore,  we 

will  assume  that  /“  crosses  each  region  P,  from  Proposition  4.2  precisely  once. 
There  exist  a  C'*“  stable  foliation  on  a  neighborhood  Uy  of  F  for  some  a  >0, 
and  it  is  no  restriction  to  assume  that  every  region  P,  is  contained  in  t/|-,  1  <  i  s  N; 
see  [PT]. 

Let  t:IR-*  W“(2)  be  a  parametrization,  and  define  a  projection  7t:F-» 
1“  by  taking  in  each  region  P,,  1  sis  N,  the  projection  along  the  local 
stable  manifolds  into  the  intersection  /“  with  that  region.  This  projection  can  be 
extended  from  F  to  the  union  of  the  regions  P,,  by  projecting  along  the  leaves  of 
the  foliation  jy'.  This  extension  will  also  be  denoted  by  it.  We  obtain  (see  [FT])  the 
following  result  that  says  that  for  some  iterate  M,  the  map  F  can  be  viewed  as 
expansive  along  unstable  segments. 

Proposition  4.4.  There  exist  a  positive  integer  M  and  a  C‘^"  map  ip  :U!li  n 

P,)-*R  defined  by  (fi(x)  =  r’’  o  ir<>  F*^  °  t(x)  such  that  >  1,  for  some  a  >  0. 

From  now  on,  let  be  N  disjoint  compact  intervals  on  the  real  line, 

and  we  write  Y  =  Uj!.i  f,-  Let  /:  T-*!?  be  a  C‘^"  map,  for  some  a>0,  with  the 
following  properties: 

(1)  /  is  on  an  open  neighborhood  U  of  Y\ 

(2)  yc:lnterior(/(y)); 

(3)  there  exists  numbers  >  1  such  that  |/'(.x)|  s  for  every  .t  e  /,,  1  s j  <  iV; 

(4)  the  transition  matrix  Ay  ,  is  primitive,  that  is,  there  is  an  integer  C?>0  so  that 
all  the  entries  of  {Ay.j)^  are  positive;  where  Ayj  is  defined  by  Ay  m)-  1 
if  f(,lj)n  l„7t0,  and  Ay./y,  m)  =  0  if  f(l,)nl„  =  0,  1 

Note  that  condition  (2)  implies  that  either  l,r\f(l„)  =  0  or  /,  n  Int  (/(/„))  =  /,, 
for  all  I  sj,  m^  N. 

The  escape  time  Ty  (x)  of  x  e  T  under /  is  the  minimum  value  n  with  the  property 
/"(x)  is  not  in  Y.  We  define  for  every  integer  k  s  1: 

A*  =  {x6  T:  ry(x)sk} 

D,  =  {xe  Y-.  Ty(x)  =  k]. 
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In  particular,  /I,  =  Y.  Hence,  for  each  integer  fc  2 1  we  have  4*+,  is  the  set  of  points 
in  Ak  whose  escape  time  from  Y  is  at  least  k;  hence  Ak+t  is  the  set  of  points  in  Y 
that  stay  in  Y  under  /*.  The  points  in  Y  which  will  stay  in  Y  under  all  iterates  will 
be  denoted  by 

A«  =  {xe  Y:  Ty{x)  =  oo} 

For  every  integer  fc  2  1  we  have: 

(a)  Ak  =  Ak^i'o  D^-, 

(b)  1^  =  uU,-i  Dj,  that  is,  Y  is  the  union  of  the  set  of  points  -4k+,  whose 

escape  time  from  Y  is  at  least  k+\,  and  the  set  of  points  D,  whose  escape  time 
from  Y  is  j,  where  1  <  /c. 

Denote  the  length  of  an  interval  L  by  |L|, 

Geometric  lemma  I.  There  exists  S;>0  such  that  for  every  integer  k^\,  the  following 
holds: 

(i)  Every  component  of  A^  contains  components  of  and  of  ; 

(i  For  each  component  D  of  D^nA,  one  has  1D|/|A|2  5y,  and  each  component  U 
of  i4|,+i  n  <4,  satisfies  \  U\I\A\  2  with  A  an  arbitrarily  chosen  component  of  A^, 

Proof  of  the  Geometric  Lemma  /.  For  each  integer  /  2  1,  we  write  R,  for  the  sum  of 
the  entries  on  the  ith  row  of  Ayj,  1  s  /V.  Assumption  (4)  implies  R,  is  at  least 
1  for  all  i,  and  the  sum  of  the  R,'s  is  greater  than  N. 

Proof  of  (i).  Let  fc  2  1  be  a  given  integer.  First,  we  assume  fc  =  1.  Let  L  be  a  given 
component  of  A\=  Y,  say  L=lj  for  some  j,  ISj'sN..  The  assumptions  (l)-(4) 
imply  f{L)  contains  R,  +  \  components  of  D, .  Since  L  =  {xe  L:  Tyix)^!}^ 
(xe  L:  Ty(x)  =  1},  we  have  that  L  contains  Rj  components  of  A,. 

Now  we  assume  /c>  1.  Let  A  be  a  given  component  of  A)..  By  the  definition  of 
An  and  the  assumptions  on  j,  we  have  y '' ' '  ( A )  is  a  component  of  A , ,  say  ^  ( A )  =  /, 

for  some  j,  IsjsN.  Therefore,  A  contains  R,  +  l  components  of  and  R, 
components  of  Ak+,. 

Proof  of  (ii).  We  are  looking  for  5,>0  such  that  for  each  integer  k  2  1  and  for 
each  component  A  in  Ai,  we  have  /i(D)//i(A)  2  5^,  and  p(U)/ p.(A)s:  Sf,  for  each 
component  D  of  D*  n  A,  and  each  component  U  of  A)(+,  n  A. 

From  (i)  and  the  assumptions  on  /  we  obtain  that  for  each  /c  2  1,  the  number  of 
components  of  A*;  and  that  of  Du  is  finite.  Let,  for  each  integer  k2  1,  N(A^)  be 
the  number  of  components  of  A^,  and  let  /V(D^)  be  the  number  of  components  of 
Dk-  We  write,  for  each  k2  1,  the  sets  Ak  and  Dk  as  the  union  of  their  components 
in  the  following  way: 

N(Aj)  N(Dj) 

Afc  =  U  At,,  Dk=  D/( 

i-i  1-1 

For  each  k  2  1  and  each  component  A  in  A^,  we  define 

a,(A)  =  mm|V|/|A|, 

where  the  minimum  is  taken  over  all  components  V  of  the  sets  Dk  and  Ak+,;  and 
we  define 

=  min  6k(A), 

A 
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where  the  minimum  is  taken  over  all  components  -4  of  the  set  Ak.  We  are  done  if 
there  exists  5/>  0  so  that  6*  a  Sf  for  all  k. 

Let  k  >  I  be  a  given  integer.  Let  <4  be  a  given  component  of  <4^,  and  let  D  be  an 
arbitrary  component  of  either  Dk  or  4*+,  such  that  A  includes  D.  From  the  foregoing, 
we  can  fix  an  integer  n(k),  1  s  n(k)<  N{Ak),  such  that  /4  =  4it  and  an  integer 
m(k),  1  s  m(k)<  N(Dk)  if  D  is  a  component  of  Dk,  and  1  s  m(k)s.  iV(/4k*i)  if  D 
is  a  component  of  4),+,,  such  that  D=  Dk,„,k\- 
Set  for  each  integer  i.  l-<,i-&k\ 


■4|-|,n,,-|i -/(4,  „|,|)  D, 


,  =  AD, 


Applying  the  mean  value  theorem,  we  can  find  for  every  integer  /,  2s  is  k,  real 
numbers  a,  in  4,,„,,,  and  d,  in  D, such  that  ly'(a,)i  ■  1-4,  =  |4, 

\f(d,)\  •  iD,,,„,,,j  =  J.  This  leads  to: 


\Dk  .mi  k )  i/|Ac  i=(_nj/(a.)/r(^/,)i)'(iD,. 


( nl/l'4|,(.' u|)- 


(1) 


From  now  on,  we  can  mimick  the  proof  of  Lemma  5.5  in  [Nu],  and  we  obtain: 


lim  n  l/'(a,)//'(d,)|>0.  (2) 

The  results  (1 )  and  (2)  imply  that  there  exists  y  .>0such  that  |Dk  „„k,l/|4k,„iki|s  y. 
Therefore,  5;  s  y  for  each  k  s  2. 

We  conclude:  |D|/|4|  s  5,  for  every  component  A  in  4;,  for  every  component  D 
with  Dc  4,  where  D  is  either  a  component  of  Dk  or  D  is  a  component  of  4k, ,, 
for  =  min  i(5,,  y}.  This  completes  the  proof  of  the  Geometric  Lemma  1. 

4.2.  Proofs  of  the  PIM  propositions 

Let  Jc  U(R)  denote  an  unstable  segment.  Recall  that  both  end  points  are  on  the 
boundary  of  the  transient  region  R,  and  that  J  intersects  the  stable  set  S{R). 

We  define  for  every  integer  k  2:  l: 

Ak(J)  =  {xeJ:  r«(x)>k}  Dk(J)  =  {xeJ:  T„{x}  =  k}. 

In  particular,  .4|(y)  =  J.  Hence,  for  each  integer  k  2  1  we  have  4k, ,(7)  is  the  set  of 
points  in  Ak(J)  whose  escape  time  from  R  is  at  least  k  +  1;  hence,  4k,i(i)  is  the 
set  of  points  in  J  that  stay  in  R  under  The  points  in  J  which  will  stay  in  R 
under  all  iterates  will  be  denoted  by  A-^iJ).  For  every  integer  k  2  1  we  have: 

(a)  Ak(J)  =  Ak.,U)^Dk(J)  (b)  y  =  4k„(i)uUD,(/). 

that  is,  J  is  the  union  of  the  set  of  points  Ak^^(J)  the  escape  time  of  which  from 
R  is  at  least  k  + 1,  and  the  set  of  points  Dj(J)  the  escape  time  of  which  from  R  is 
J,  where  l^j^k.  We  write  DAJ)  =  [Jk^,  Dk(J).  Note  that  A,,(J)  =  r]'^,oMJ), 
and  J  =  4jo(y)u  Dx(y).  In  the  lemma  below  we  will  state  that,  if  the  value  of  the 
escape  time  map  T«  changes  then  it  changes  in  steps  of  1. 
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T-jump  lemma.  For  every  X6  D^(J)  there  exists  an  e>0  such  that  for  each  y&J 
with  p([x,  y]j)  <  £  one  has  \Tk(x)- Tn{y)\'^l. 

Proof  of  the  7- Jump  Lemma.  Let  xe  D*(J)  be  given.  We  will  write  D'i\J)  = 
Ur.i  lnt{Dk(y)),  where  Int(Dk(J))  means  the  interior  of  Dk(J)  for  each  kzl. 
First,  consider  the  case  where  .ve  D'^'{J).  Then,  by  the  definitions,  is  constant 
on  the  component  of  DT(J)  including  x.  Consequently,  there  exists  an  e>0  so 
that  7R(y)=  7r(x)  for  all  y  in  J  with  p([.x,  >’]y)<  p. 

Now  we  consider  the  case  where  xe  DAJ)\DT(J)-  Let  M  sO  be  the  integer  for 
which  f  ^(.v)e  Bndy  (R),  where  Bndy  (R)  means  the  boundary  of  R.  From  the  fact 
that  each  point  in  Bndy  ( R)  is  mapped  outside  R  it  follows  that  Tk(x)  =  M  +  \.  We 
obtain  that  there  exists  p  >  0  so  that  for  each  ,v  e  J  with  p([x,  y]j )  <  p  either  7jf(>  )  = 
M  or  7r(>')  =  /Vf  +  1. 

We  conclude:  there  exists  p  >0  so  that  for  every  yeJ  with  p([.v,  ,v]7)<  p  either 
Tk(x)  =  TK(y)  or  |7r(x) -  TKfy)!  =  1.  This  completes  the  proof  of  the  7-Jump 
Lemma. 

Denote  the  length  of  a  segment  Ley  by  p(L). 

Geometric  Lcmma  II.  Tltere  exists  5>0  such  that  Jor  every  J  in  U{R),  and  for 
each  integer  fe  a  1,  the  following  holds: 

(1)  Each  component  of  A^U)  contains  components  of  Dk(J)  and  Ak^t(J)\ 

(2)  Let  A  be  an  arbitrarily  chosen  component  of  Ak(J).  For  each  component  D  of 
Dk(J)rsA,  one  has  p(D)/p(A)=:S,  and  each  component  U  of  Ak^^(J)nA, 
satisfies  p(  {y)/p(A)  a  5. 

Proof  oj  Geometric  Lemma  //.  Let  J  6  U(R).  Proof  of  ( 1 ).  For  /c  =  1 ,  the  assumptions 
(A1)-(A4)  imply  that  A|{y)  =  J  contains  at  least  two  components  of  D|(J).  and  it 
contains  at  least  one  component  of  A^U)-  Now  assume  k>l,  and  let  A  be  a 
component  of  Ak(J).  By  the  definition  of  A^J)  and  the  assumptions  on  F,  we  have 
F'‘''(A)  is  a  component  of  U(R).  Hence,  A  contains  at  least  two  components  of 
Dk(J)  and  at  least  one  component  of  Aj,,^i(y). 

Proof  of  (2).  Let  U  be  a  neighborhood  of  Inv  iR)on  which  a  stable  foliation 
exists,  for  some  a  >  0.  The  case  that  a  basic  set  is  nontrivial  periodic  is  similar 
to  that  of  a  nonperiodic  basic  set  but  the  notation  is  more  complicated.  Therefore, 
we  assume  that  every  basic  set  in  Inv  (F)  is  either  nontrivial  nonperiodic  or  trivial. 
For  each  nontrivial  nonperiodic  basic  set  7  let  /  “  and  the  regions  i?,(  D,  1  ^  i  s  /V(  D, 
be  as  in  Proposition  4.2,  and  let  U,  be  an  open  neighborhood  of  F  such  that  (1) 

’  F,(r)c  U[  U,  (2)  the  set  n  I/,  )  and  its  closure  consist  both  of  NiV) 
components, and(3)the map<p  in  Proposition 4.4 may  beextended  to  t  '  (/“n  U, ). 
For  each  trivial  basic  set  F,  let  Ui  be  an  open  neighborhood  of  F  in  U  such  that 
Urn  Uk  is  empty,  fc;  each  basic  set  in  Inv  (F)\F.  Select  an  integer  K  ^  1  such 
that  the  union  of  the  Ur's  include  Aii(J)\  the  existence  of  K  is  guaranteed  by  the 
fact  that  AkU)-*  VV"(Inv  (R))nJ  as  /c-*oo.  From  the  assumptions  on  F  we  obtain 
that  the  number  of  components  of  both  AkU)  and  Dk(J)  is  finite  for  ail  k.  For 
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every  k  a  1  and  each  basic  set  T  in  Inv  ( /?),  we  define  6k{J)  =  min^  min  v  p{  V)lp(A) 
and  Sk{J ;  D  =  min^  {min v  p(  V)/p(A)-:  A  n  F  is  nonempty},  where  the  minimum  is 
taken  over  all  components  V  of  the  sets  Dk(J)  and  Ak*\(J),  and  all  components 
A  of  the  set  Ai,{J)  such  that  V'c  A.  Obviously,  6k(J)^Sk(J-,  D,  for  all  k 

Let  r  be  a  basic  set  in  Inv (R).  Write  Ur(R)  =  {J e  U(R):  J nT  is  nonempty}. 
We  first  show:  there  exists  6i  >0  such  that  for  each  Je  Ur(R),  for  all  ka  1,  and 
for  every  component  A  of  Ak(J)  that  intersects  F,  one  has  every  component  D  of 
Dk(J)r\  A  satisfies  p(D)lp(A)  a  S,-,  and  each  component  U  of  Ak^.i(J)n  A  satisfies 
p(  U)/ pi  A)  a  6| .  The  case  that  F  is  a  periodic  orbit  is  left  to  the  reader.  We  assume 
that  F  is  a  nontrivial  nonperiodic  basic  set. 

Applying  Proposition  4.4  and  Geometne  Lemma  I  we  obtain  that  there  exists 
5„(J;F)>0  such  that  F) a ^,.(7;  F)  for  all  k>  K.  We  write  5^(7;  F)  = 
tnini^ki*;  F),  then  F) a 6^(7;  F)  for  all  Now  we  define 

5(7;  F)  =  min  |5„{7;  F),  5(,(7;  F)}>0  and  get  p(  V)/p{A)a  5(7;  F)  for  every  com¬ 
ponent  A  of  AkiJ)  and  every  component  V  with  Vc  A,  where  V  is  either  in  Dt{7) 
or  in  At+,(7).  Now,  we  define  Sp  =  inf  {5^7;  F):  76  Uf  (R)).  Since  (7|(/?)  is  compact 
we  obtain  5c  =  min  {5(7;  F):  7  6  U\  {R)]>0.  Finally,  since  F  was  arbitrarily  given, 
we  define  5  =  min  {5c:  F  basic  set  in  Inv  (/?)},  and  conclude  5i(7)  a  5  for  all  k  a  |. 
This  completes  the  proof  of  Geometric  Lemma  II. 

Proof  of  Proposition  1 .  Let  L  be  as  in  the  proposition. 

■{i)=*(ii)’:  We  assume  that  there  exists  e  >0  such  that  every  f-refinement  of  {a,  b) 
includes  a  PIM  triple.  If  the  interior  of  L  does  not  include  a  point  of  Inv  (/?),  then 
Ar(7)n  L  is  empty,  and  thus  no  f-refinement  of  {a,  b)  includes  a  PIM  triple.  Hence, 
the  interior  of  L  contains  a  boundary  point  of  ( 7 )  for  some  integer  k  a  0.  Therefore, 
the  interior  of  L  intersects  A, (7). 

■(ii)=*(i)’:  Now  we  assume  that  the  interior  of  L  contains  a  point  q  of  Av(7)nF, 
for  some  basic  set  F  in  lnv(f?).  Select  integer  Mai,  such  that  L  contains  a 
component  A  of  Am (7)  that  includes  q.  Let  5 >0  be  as  in  the  Geometric  Lemma 
11.  Now  we  select  e  =  5*  •  pt  A).  From  the  Geometric  Lemma  II  we  know  that  A 
contains  at  least  two  components  of  Dm  (7)  whose  length  of  each  of  them  is  at  least 
5  •  p(A),  and  A  contains  one  or  more  components  of  Am,^i  whose  length  of  each 
of  them  is  at  least  5  •  p(  A).  We  obtain  that  each  f-refinement  of  a  and  b  includes 
a  PIM  triple  in  A.  This  completes  the  proof  of  Proposition  1. 

From  now  on,  we  fix  5  as  in  Geometric  Lemma  II  and  e  =  5^ 

ProoJ  of  Proposition  2.  Let  ia,c,b)  be  an  Interior  Maximum  triple  in  7.  First,  we 
assume  that  T„ia)^  Tr(6)<  T^ic). 

Case  1.  Assume  k  =  mina^^^j,  Tf<ix)<  T^ia).  Let  D  be  the  component  of  Dj,(7) 
containing  at  least  one  point  of  [a,  b]j,  for  which  TK(y)  =  k  for  all  y  in  D.  Then 
Dc  int  ([a,  A,  where  A  is  the  component  of  A^iJ)  for  which  A.  Since 
p(la,b]j)<piA),  applying  the  Geometric  Lemma  11  gives  p(D)/p([a, 6];)s5. 
Then,  for  every  /3-refinement  Pg  of  (a,  c,  b),  with  0</3£5  we  have  PpnD?‘^0. 
We  obtain:  for  each  peP^nD  either  ( p,  c,  b)  or  (a,  c,  p)  is  a  PIM  triple  in  P^. 
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Case  2.  Assume  minas;.s6  Tk{x)3:  T^ia)  and  Tk(c)z  TR(a)  +  2  =  m  +  \.  Then,  by 
the  T-Jump  Lemma,  there  exists  a  component  D  of  D„(J)  in  the  interval  [a,  c]j. 
Since  [a,  b]j  lies  in  a  component  A  of  A„.i(J),  the  Geometric  Lemma  II  implies 
p(D)/p([a,  b];)  a  5.  Hence,  every  /3>refinement  of  (a,  c,  t>)  includes  a  point  p  of  D, 
so  ( p,  c,  b)  is  a  PIM  triple,  where  0<  /3  s  fi. 

Case  3.  Assume  r«(c)  =  7^(0)  + 1  =  m  and  that  Case  1  docs  not  apply.  This  implies 
TR(b)  =  Tnia).  Set  P  =  let  be  a  /3-refincment  of  (a,c,b),  say  Pfl  = 
{x, :  Os  I  s  N(p))cj  with  fl  ==.Xo<x,  <  •  •  •  <Xm3,  =  6  and  X),  =  c  for  some  1  s  Ics 
N{p)-\. 

From  the  Geometric  Lemma  11  we  get  that  [a,b]j  contains  a  component  D  of 
D„»i(y),  and  p{D)/p{[a,b]j)^8\  We  obtain  that  every  /3-refinement  of  (a,c,b) 
includes  a  PIM  triple  for  each  0<  /3  s  S\ 

The  case  r«{b)s  Tr(<i)<  Tr(c)  is  similar.  The  conclusion  is:  For  e  =  5^  we  have: 
every  f-refinement  of  a  PIM  triple  in  J  includes  a  PIM  triple.  This  completes  the 
proof  of  Proposition  2. 

Proof  of  Proposition  3.  Left  to  the  reader. 

Before  we  will  prove  Proposition  4.  we  will  present  a  monotonicity  property  for 
the  escape  time  map  as  well  as  an  auxiliary  observability  result  for  Accessible  PIM 
triple  sequences. 

Monotonicity  Lemma.  Let  a  and  c  be  two  points  on  J,  and  let  Pc[a,  be  a 
^-refinement  of  a  and  c,  say  P  =  {x, :  Os  i  s  N(p))  and  a  =  .Vo<  X|  <  •  •  ■  <  Xstn)  = 
where  li>0.  Assume  that  Tr  is  monotonic  on  P  (that  is,  r«{xji»,)a  r«(xt),  Os/i< 
N(/3)-  I),  and  T«(c)>  r«{a).  Write  rn  =  min  {TrIx):  x6  (a,  c]^}. 

Then,  for  every  /J,  0<(i<8,  D„(J)r\[a,c]j  consists  o)  one  component,  and  it 
includes  c 

Proof  of  the  Monotonicity  Lemma.  Let  /3,  a,  c,  P,  Tr,  and  m  be  as  in  the  Lemma. 
By  the  definition  of  m,  we  know  that  [a,  c]y  is  contained  in  a  component  A  of 
A„(J).  Assume  that  0<p<S. 

Suppose  that  TR(a)>m.  Then  there  is  a  component  D  of  D„(J)  such  that 
Dc.[a,  c];.  (Note  that  neither  a  nor  c  is  contained  in  D.)  From  Geometric  Lemma 
II  we  know  that  p(D)/pi[a,  c]j)^ p(D)/ p(A)  s  S  >  /3;  this  implies  Pn  0.  But 
this  contradicts  the  assumption  Tr  is  monotonic  on  P.  Hence,  m  =  TrIo). 

Suppose  D„(J)r![a,  c]j  consists  of  two  components,  say  D  and  D'.  We  will 
assume  D'  includes  a.  The  Geometric  Lemma  II  implies  there  exists  a  component 
U  of  A„.,,(J)  between  D  and  D'  such  that  p(U)/p([a,c]j)^p(U)/p(A)s:S> (i. 
We  obtain  that  P  includes  a  PIM  triple  (a,c',b')  with  c'ePnU  and  b'ePnD 
(since  both  p(D)/p([a,  c]j)>  and  p(U)/ p([a,  c]j)>  fi),  which  contradicts  the 
monotonicity  of  Tr  on  P.  This  completes  the  proof  of  the  Monotonicity  Lemma. 

Observability  Lemma.  Let  PcJ  be  an  e 1 2 -refinement  of  an  Interior  Maximum 
triple  (flo.  t'o.  bo)  in  J,  and  assume  Tr(x,)^  TrIoo)  for  every  x.  €  P.  Let  (Uq,  c,  ,  6,) 
be  the  PIM  triple  in  P,  in  which  b,  and  Ci  are  selected  as  in  the  Accessible  PIM  triple 
procedure,  and  let  al  and  a  |  be  defined  as  in  the  Accessible  PIM  triple  procedure. 
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If  Pis  an  e-refinement  of  (fln.  C|,  6,),  then 
(i/  If  a'\>  an  then  [oo.  wo*  intersect  S{R)i  otherwise, 

(ii)  if  a?  =  flo  then  TK{bx)>  7^(00),  al  <  Ci  and  [oq,  a\]j  does  not  intersect  S{R). 
Proof  of  Observability  Lemma.  Let  P,  (a,).  fi.  i>i).  o?  and  a|  be  as  in  the  Lemma, 
and  assume  Pr\[ao,  i>i]y  is  an  e-rcfincment  of  (flo.  Ci,  ii).  Note  that  from  this  latter 
assumption  it  follows  that  Pn[ao,(|]j  is  a  ;3-refinement  of  {oo.ci}  for  some 
0</3<6. 

Let  m  =  min  {T^lx):  x€[ao,  The  assumptions  ‘Tk(ac,)2  TrCoo)  for  all  x.e 
P\  'Pr\[an,  b^]j  is  an  e-rcfinement  of  (Un,  ti,  b^Y,  and  the  Geometric  Lemma  11 
imply  that  m  = 

Proof  of  (i).  Assume  that  a\'>an.  By  the  Monotonicity  Lemma  we  obtain  that 
r«(jc)  =  T^ioo)  for  all  xe  Loo,  u'i’L  i  hence,  [oo,  a'i]j  does  not  intersect  S(R). 

Proof  of  (ii).  Assume  that  a\‘  =  ao.  Suppose  T^(bi)  =  T^{ao)  =  m.  From  the 
Geometric  Lemma  11  and  the  assumptions  we  get  that  the  interval  [ou.  l>i]y  contains 
one  component  A  of  and  piA)/p([an,  bi]j)>  S.  Applying  the  Geometric 

Lemma  11  again,  we  get  that  there  are  at  least  2  components  L*,  and  U2  of  D„,.t{J) 
and  at  least  one  component  L*j  of  in  A,  and  for  each  k,  I  si: £3, 

p{U)/p([ao,b^]j)=(p{Ut,)/p(A)){p(A)/p([a,ub^]j)>S-  =  F.  Hence,  each  t/*, 
I  <  Ic  s  3,  contains  at  least  one  point  of  P.  This  implies  l>i  is  not  the  leftmost  point 
in  P  that  is  the  right  point  in  a  PIM  triple,  which  contradicts  the  assumption. 
Conclusion:  7'h(/»i)>  TrIuo). 

The  facts  '(ao.Ci.h|)  is  a  PIM  triple’  and  'Tu(an)<  T^iby)'  imply  r«(Ci)s 
7^(0, ))  +  2.  We  obtain  from  the  Geometric  Lemma  II  that  there  is  a  component  D 
of  D„,,(7)  in  [flo,  t'll^  such  that  p(D)/p([o„,  b,]j)^S.  Using  the  T-Jump  Lemma, 
we  obtain  that  there  is  a  point  qeDnP  with  T^iq)-  T/<(an)+l  and  for  all  x  in 
P  between  a,,  and  q  one  has  7^(00)-  Tr('c)-  Tni.aa)-t- 1.  It  follows  that  the  point 
al  exists.  Applying  the  Monotonicity  Lemma  we  obtain  m  =  r«(ao)^  7r(x)s 
7^(0',)  =  m  + I  for  all  .v€[oo,  oj]y ;  hence,  [a,),  al]j  does  not  intersect  S{R).  This 
completes  the  proof  of  the  Observability  Lemma. 

Proof  of  Proposition  4.  Let  e  be  as  in  Proposition  2,  and  let  {(a„,  c„,  be  an 

Accessible  PIM  triple  sequence  in  J,  that  is,  (a„,Cn,b„)  is  an  Interior  Maximum 
triple  and  for  ns  I,  {a„,c„,b„)  is  obtained  by  the  Accessible  PIM  triple  pro¬ 
cedure.  For  nsO,  let  P„  be  an  e/3-refinement  of  the  Interior  Maximum  triple 
(a„,  c„,  b„),  and  recall  that  M„  =  min  {r«(.v,):  x,  e  P„,  x,  <  Further,  we  write 
=  min  (TrIx,):  .V,  e  P„}.  Note  that  the  Geometric  Lemma  11  implies 
m„  =  min  {7n(x):  xe[a„,b„]j}. 

We  will  show  that  there  exists  an  integer  NsO  such  that  for  every  integer 
nsN:  rR(aJ  =  M„;|TR(a„.,)-rR{aj|sl;  and  [a„,a„*,]j  does  not  intersect 
S(R). 

From  the  T-Jump  Lemma,  the  Geometric  Lemma  11,  and  the  assumption  that 
{(a„,  c„,  b„)]„^i  is  obtained  by  the  Accessible  PIM  triple  procedure  we  obtain  for 
each  n  s  0,  the  following  properties: 

(1)  if  rR(aJ>M„  then  rR(a„.:)  =  M,; 

(2)  if  7a{b„)  =  m„  then  7^ib„^t)>7K(b„)  +  l\ 


206 


H.  E.  Susse  and  J.  A  Yorite 


i3)  if  T*(6,)  =  iii,  and  M,>m^  then 
(4)  if  r«(6,)>m,  and  M,  >111,  then 

These  propenies  imply  that  there  exists  a  minimal  integer  N  ^0  such  that  Tnfjc.)  ^ 
Ms  =  niv  -  T,(a.v )  for  eadi  x,  e  Pv- 

Case  1.  Pf.  is  no  e-  'finement  of  (Ov. Cv-f.6N*i)-  Since  Ov.,  =  0^.  we  have  (I) 
r*(x,)  >  Afv,i  =  ntvi  =  T^ias-^t)  for  each  .T,e  Pv^i.  and  (2)  [ov,  Jv-iL  do«  "o* 
intersect  SiR).  Obviously,  r*(x»=  Tulav)  for  all  x  in  (a.v,  Uv-.L- 
Case  2.  Ps  is  an  c-refinement  of  (a.v,  Cv-i,  bv*i)-  *nrst.  assume  that  aN.,>av- 
By  the  Monotonicity  Lemma,  and  the  Observability  Lemma  we  obtain  for  av.i  = 
flv.,:  «1)  T„lx)  =  T„{a^  I  for  all  .vSiUv,  Ov-ib, 

(2)  Tpt  V.)  >  A#v-i  =  mv*i  =  PrIuv-.J  for  each  x,€  P>..,,  and 

(3)  [<iv. a.v,.,]y  does  not  intersca  SiR). 

Now  assume  that  a  ^ =  a  v  Applying  the  Monotonicity  Lemma,  and  the  Observa¬ 
bility  Lemma  yields  for  a 1  =  av,i;  (1)  Th{x)=  T^ios)  forevery  .xe(a,v.  a,v,i]7, 
{.2)  rKlx,)2:Af.vi  =  »nv*i  =  T. 'a.v.,)  =  TkIo.vI  +  I  for  each  x,ePv*i,  and  (3) 
[ajv,  a^,*,]y  does  not  intersect  S(R). 

By  induction,  one  obtains  the  desired  result.  This  completes  the  proof  of  Proposi¬ 
tion  4. 

Proof  of  Proposition  5.  Left  to  the  reader. 

5.  Discussion  of  the  numeri  ~al  procedures 

Now  we  will  return  to  the  ‘dynamic’  question  addressed  in  the  beginning,  namely, 
how  can  you  numerically  follow  a  trajectory  on  an  invarian:  set  for  an  arbitrarily 
long  period  of  time? 

A  line  segment  [a,  b]  straddles  the  stable  manifold  of  a  point  P  if  [a.  b]  intersects 
this  manifold  transversaliy.  Ip  the  cases  we  o:udy,  P  will  be  replaced  by  chaotic 
saddles  (nontrivial  basic  sets)  and  [a,  b]  will  straddle  a  subset  of  5(  R ).  Furthermore, 
in  practice  [a,  b]  will  be  very  short  and  will  be  extremely  cIpsc  to  the  invariant  set 
Inv(R). 

The  numerical  procedure  goes  as  follows:  (1)  Choose  'with  some  experimenting) 
a  straight  line  segment  /;  (2)  Apply  PIM  triple  proced  efine  and  choose  PIM 
triple  ini-rval)  repeatedly  until  the  length  of  the  PIM  triple  interval  is  less  than 
some  distance  a  (e.g.  a  =  lO'**);  call  this  interval  /,>=  PIM„(/);  (3)  For  a  straight 
line  sCb-Ticnt  L  with  end  points  a  and  b,  we  write  P1M„(L)  to  denote  either  [a,  b] 
if  |[a,  f>]i<  or  or  the  resulting  interval  when  some  PIM  triple  procedure  is  applied 
•  ntil  an  interval  of  length  less  ihan  tr  is  reached.  Note  that  this  operator  depends 
oniy  on  the  end  points  of  L.  The  basic  process  then  is  iterating  PIM.,(F(L)). 
While  F(L)  is  an  interval,  only  F[a)  and  F(b)  are  relevant.  Thus  we  obtain 
/„+,  =  FIMct{F(/„)),  a  sequence  of  straight  line  segments. 

We  thus  obtain  a  trajectory  of  tiny  straight  line  segments  I„  and  to  the  precision 
of  the  computer  (..bout  10"'^)  we  typically  have  F(/J,  and  selecting  any 
point  x„  from  /„,  perhaps  the  midpoint,  we  have  that  |x„..,  -  F(x„)|  is  small,  typically 
of  the  order  of  tr.  Since  computers  can  never  be  expected  to  produce  true  trajectories 
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(excqn  in  trivial  cases  such  as  fixed  points),  we  may  say  is  a  numerical 

trajectory.  We  call  the  sequence  of  intervals  a  saddle  straddle  tmjeaory 

because  the  interval  straddles  a  piece  of  the  stable  set  5(R)  of  a  chaotic  saddle  set. 
It  typically  approximates  (after  a  few  iterates)  a  basic  set  in  the  invariant  set  (whidi 
is  a  chaotic  saddle)  in  the  interesting  cases.  Furthermore,  a  saddle  trajeaory  approxi¬ 
mates  the  trajectory  of  a  point  in  the  Static  Restraint  Problem.  Despite  the  complexity 
of  the  construction,  we  will  r<;fer  to  as  the  'iterate'  of  x,. 

Remark.  In  practice  we  find  that  every  c-refinement  of  two  points  {a,b],  with 
e  =  1/30,  includes  several  PIM  triples.  In  computing  the  sequence  of  PIM  triples 
{a„,  c„,  b„)  defined  by  the  Accessible  PIM  triple  procedure,  once  either  case  3(iii) 
or  3(iv)  holds,  and  if  c  is  more  than  r  -  |b  -<i|  from  a  and  b,  then  it  can  be  shown 
that  every  r-refinement  of  the  end  points  {a,  b]  of  a  PIM  triple  (a,  c,  b)  includes  a 
PIM  triple;  in  the  computer  program  we  do  not  use  c  at  all.  For  the  examples  in 
this  paper  and  in  [NY]  we  find  that  the  .Accessible  PIM  triple  procedure  leads  to 
accessible  fixed  points  or  periodic  points,  which  is  in  agreement  with  the  fact  that 
all  the  accessible  points  for  two  dimensional  hyperbolic  systems  are  on  the  stable 
manifolds  of  finitely  many  periodic  points. 

In  this  paper  we  have  shown  that  our  procedures  are  valid  in  ideal  situations. 
We  find  it  works  well  in  practice  even  in  less  than  ideal  cases.  From  the  examples 
in  [NY],  we  have  seen  that  the  PIM  triple  procedure  works  quite  well  for  a  variety 
of  dynamical  systems. 

It  is  important  to  ask  if  such  straddle  trajectories  represent  true  trajectories  of 
the  system.  In  other  words,  does  there  exist  a  true  trajectory  of  the  system  that 
shadows  (i  e..  stays  close  to)  the  numerical  trajectory  obtained  by  the  PIM  triple 
procedure?  When  a  map  is  sufficiently  hyperbolic  on  the  invariant  set  in  question. 
Bowen  [B]  obtained  a  result  saying  that  each  noisy  trajectory  in  the  nonwandering 
set  can  be  shadowed  by  a  true  trajectory  if  the  perturbation  is  small;  see  [B]  for 
the  precise  statement..  We  will  say  that  Inv  (R)  satisfies  the  'no  cycle  condition'  if 

for  every  family  of  basic  sets  Fi,, . .  Fumi  in  Inv  (R)  such  that  the  stable  set  of 

Fk.)  has  a  nonempty  intersection  with  the  unstable  set  of  F^,..,,  for  all  1  <  i<  M, 
the  stable  manifold  of  Fi,m,  does  not  intersect  the  unstable  manifold  of  Fi,,)- 
Assuming  Inv(R)  satisfies  the  'no  cycle  condition'  and  S  is  sufficiently  small,  we 
can  show  that  every  saddle  straddle  trajectory  of  a  two  dimensional  uniformly 
hyperbolic  system  with  a  chaotic  sadale  obtained  by  the  PIM  triple  procedure,  can 
be  shadowed  by  a  true  trajectory  for  as  long  as  the  saddle  straddle  trajectory  can 
be  computed. 

6.  Concluding  remarks 

6.1.  Higher  dimensional  systems.  One  of  the  ingredients  in  the  analysis  of  the  validity 
of  the  PIM  triple  procedures  in  dimension  two,  is  the  existence  of  a  C'*"  foliation 
on  a  neighborhood  of  a  basic  set.  The  existence  of  such  a  foliation  for  the  two 
dimensional  case,  is  guaranteed  by  a  result  due  to  De  Melo  [M].  Unfoitunately, 
the  existence  of  a  foliation  Jv’  on  a  neighborhood  of  a  basic  set  in  higher  dimensions 
is  not  known,  see  e.g.  [PT]. 
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Let  from  now  on,  the  dimension  n  ^  3.  Let  F  be  an  Axiom  A  diffeomorphism. 
let  R  be  a  saddle-hyperbolic  transient  region  for  which  dim  E“  =  I,  and  assume 
that  for  each  basic  set  F  in  lnv(i{)  there  exists  a  C'"*  suble  foliation  fv'  on  a 
neighboriiood  of  F,  for  some  a  >0.  Then  the  Propositions  1,  2,  3. 4.  and  5  are  still 
valid.  The  proof  is  almost  the  same,  except  instead  of  Propositions  4.1  and  4.2  one 
should  use  the  properties  of  Markov  partitions  of  basic  sets,  see  Bowen  [B]. 

6.2.  Order  of  Differentiability  of  the  Diffeomorphism.  We  assumed  that  the 
diffeomorphism  F  is  C’.  This  assumption  implied  the  existence  of  a  C*'"  expanding 
map,  for  some  a  >  0,  in  Proposition  4.4.  If  F  is  of  class  C'.  then  it  is  known  that 
such  an  expanding  map  is  C'.  We  would  like  to  point  out.  that  the  Holder  exponent 
a  is  only  used  to  obtain  (2)  in  the  proof  of  the  Geometric  Lemma  I.  Fortunately., 
we  can  prove  the  Geometric  Lemma  1  (in  particuh.'  property  1 2))  for  the  C'-map 
IP  of  Proposition  4.4  by  combining  the  techniques  of  the  proof  of  Proposition  6  in 
[Ne]  and  Lemma  5.S  in  [Nn],  Thus  in  fact,  it  is  sufficient  to  assume  F  is  C*  to 
guarantee  the  main  results  of  the  paper. 
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Mathemattcal  formulations  oi  the  emoeddine  methods  commoniv  usco  for  the 
reconstruction  •>!  attractors  iram  uata  ^crles  are  oiscusscu.  f.-nbcaoinc 
ineorcms.  oasco  on  previous  worx  r«v  H  Whitnev  anu  F  T-kens.  -re  cstao- 
iisheo  for  compact  suosets  .t  of  Euclidean  ^oace  R'  If  n  i^  an  inieecr  larecr  man 
twice  the  box-counttne  dimension  of  then  almost  every  map  irom  R’  to  /?*. 
in  the  Ncnse  of  prevalence.  :s  one-to-one  on  .-1.  and  moreover  is  an  embeddinc 
on  smooth  manifolds  contained  within  -I.  If  .-1  is  a  chaotic  attractor  of  a  typical 
dynamical  system,  then  the  same  is  true  for  almost  every  Jelav-iuordinaie  mip 
from  R"  to  R*.  These  results  are  e.xtended  m  two  other  direaions.  Similar  results 
are  proved  m  the  more  general  case  of  reconstructions  which  use  moving 
averages  of  delay  coordinates.  Second,  information  is  given  on  the  scif-intcrscc- 
tion  set  that  exists  when  a  is  less  than  or  equal  to  twice  the  hox-countinc 
dimension  of  .-1. 


KEY  WORDS:  Embedding,  chaotic  .ittractor;  .ittractor  reconstruction, 
probability  one:  prevalence;  box-counting  dimension:  delav  coordinates 


1.  INTRODUCTION 

In  this  work  we  give  theoretical  justification  of  data  embedding  techniques 
used  by  experimentalists  to  reconstruct  dynamical  information  from  time 
scries.  We  focus  on  cases  in  which  trajectories  of  the  system  under  study 
ire  asymptotic  to  a  compact  attractor.  We  state  conditions  that  ensure  that 
the  map  from  the  attractor  into  reconstruction  space  is  an  embedding, 
meaning  that  it  is  onc-io-onc  and  preserves  difierential  informationrOtTr" 
approach  integrates  and  expands  on  previous  results  on  enb^ding  by 
Whitney'*”  and  Takens.'*” 
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Whitney  showed  that  a  generic  smooth  map  F  from  a  J-dimensionai 
smooth  compact  manitoid  St  to  is  actually  a  diffeomorphism  on  St. 
That  IS.  St  and  F{St\  arc  diffcomorphic.  We  generalize  this  in  two  ways: 
first,  jy  replacing  "gencnc"  vnh  “probabiliiy-one"  lin  a  prescribed  sensei, 
and  second,  by  replacing  the  manifold  St  by  a  compact  invariant  set  .4 
contained  in  R*  that  may  have  nonmteger  box-counting  dimension 
iboxdimi.  In  that  case,  we  show  that  almost  every  smooth  map  irom  a 
neighborhood  of  .-I  to  R"  is  one-to-one  as  long  as 

/I  >  2  boxdimi  .-1 ) 

We  also  show  that  almost  every  smooth  map  is  an  embedding  on  compact 
subsets  of  smooth  manifolds  within  .1.  This  suggests  that  • -ading 

techniques  can  be  used  to  compute  positive  Lyapunov  ox;  .;s  'but 

not  necessarily  negative  L'.apunov  exponents i.  The  positixc  u..JDuno\ 
exponents  are  usually  carried  by  smooth  unstable  maniioids  I'P.  .iitractors. 
We  give  precise  definitions  of  one-to-one.  embedding,  and  almost  o'.ery  in 
the  next  section. 

Takens  dt..ii  with  a  restricted  class  of  maps  called  dela\ -coordinate 
maps.  A  delay-coordinate  map  is  constructed  from  a  time  scries  oi  a  single 
observed  quantity  from  an  experiment.  Because  of  this,  a  typical  delay- 
coordinate  map  is  much  more  likely  to  be  accessible  to  an  experimentalist 
than  a  typical  map  Takens  *'*  showed  that  if  the  dynamical  system  and  the 
observed  quantity  are  generic,  then  the  delay -coordinate  map  irom  a 
(/-dimensional  smooth  compact  manifold  St  to  /?**'''  is  a  diffeomorphism 
on  St. 

Our  results  generalize  those  of  Takens'*  '  m  the  ^ame  two  uays  as  for 
Whitney  s  iheorem.  N'amelv.  we  replace  generic  unh  probability-one  and 
the  manifold  \f  by  a  possibly  iractal  >et.  Thus.  lor  a  compact  uuariant 
subset  .1  of  R\  under  mild  conditions  on  the  dynamical  system,  almost 
every  delay-coordinate  map  F  from  /?*  to  R"  is  one-to-one  on  provided 
that  /I  >  2  boxdimt.  n.  Also,  any  manifold  structure  within  I  will  be 
preserved  in  ff.-l).  These  results  hold  for  lower  box-counting  dimension 
(see  Section  4)  if  boxdim  does  not  exist.  The  ambient  space  R*  can  be 
replaced  by  a  A- -dimensional  smooth  manifold  in  the  general  case.  In 
addition,  we  have  made  explicit  the  hypotheses  on  the  dynamical  system 
(discrete  or  continuous!  that  are  needed  to  ensure  that  the  delay-coor¬ 
dinate  map  gives  an  embedding.  In  particular,  only  C'  smoothness  is 
needed.  For  llows.  the  delay  must  be  chosen  so  that  there  are  no  periodic 
orbits  whose  period  is  exactly  equal  to  the  time  delay  used  or  twice  the 
delay.  (A  finite  number  of  periodic  orbits  of  a  flow  whose  periods  are  p 
times  the  delay  are  allowed  for  p^2.)  Further,  we  explain  what  happens 
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case  that  boxdimi.'l).  In  that  case  we  put  bounds  on  the 
on  of  the  seif-intersection  set.  which  is  the  set  on  which  the  one- 
property  fails.  Finally,  we  give  more  general  versions  of  the  deiay- 
ate  theorem  which  deals  with  filtered  delay  coordinates,  which 
lore  versatile  and  useful  applications  of  embedding  methods, 
ere  are  no  analogues  of  these  results  where  the  box-counting 
on  is  replaced  by  Hausdorff  dimension  (see  Theorem  4.7  and  the 
on  that  follows  I.  In  an  .\ppendix  to  this  work  written  by  I.  Kan. 
:s  are  described  of  compact  subsets  of  /?*,  for  any  positive  integer 
1  have  Hausdorff  dimension  d=0.  and  which  are  difficult  to  project 
e-to-one  way.  The  requirement  n  >  Id  discussed  above  translates  in 
e  to  «  >  0.  However,  every  projection  of  such  a  set  to  R”.  n  <  k.  fails 
ne-io-one. 

Section  2  we  e.xplain  the  new  version  of  the  Whitney  and  Takens 
me  theorems.  In  Section  3  ae  discuss  filtered  delay  coordinates. 
4  contains  proofs  of  the  results. 

\N  TO  EMBED  MANIFOLDS  AND  FRACTAL  SETS 

•actal  Whitney  Embedding  Prevalence  Theorem 

sume  0  is  a  flow  on  Euclidean  space  /?*.  generated,  for  e.xample.  by 
•nomous  system  of  k  dilTercniial  equations,  .\ssume  further  that  all 
ries  are  asymptotic  to  an  attractor  .■(.  The  study  of  long-time 
tr  of  the  system  will  involve  the  study  of  the  set  .1. 
a  typical  scientific  e.xpenment.  the  phase  space  /?*  cannot  be 
ly  seen.  The  e.'tperimcnter  tries  to  infer  properties  ol  the  system  by 
measurements.  Since  each  state  of  the  dynamical  svstem  is  uniquely 
d  by  a  point  in  phase  space,  a  measured  quantity  is  a  function  Irom 

pace  to  the  real  number  line.  If  n  independent  quantities  Q, . Q„ 

measured  simultaneously,  then  with  each  point  in  phase  space  is 
ted  a  point  in  Euclidean  space  R".  We  can  then  talk  about  the 
:meni  tunciion 

F(statci  =  (Q, . QJ 


naps  /?*  to  R”. 

r  e.xample,  suppose  all  trajectories  in  phase  space  R*  are  attracted 
riodic  cycle.  Thus,  .1  is  topologically  a  circle  lying  in  /?*.  Imagine 
0  available  measurement  quantities  Qi  and  are  plotted  in  the 
Then  there  is  a  measurement  map  F  from  A  to  R^  given  by 
)  =  (2i,0:).  To  what  extent  are  the  properties  of  the  hidden 
)r  A  preserved  in  the  observable  “reconstruction  space”  R^l 
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The  answer  depends  on  how  the  circle  is  mapped  to  under  F. 
Consider  the  case  where  i?*  =  and  Qi  and  C  ‘re  simply  the  two  coor¬ 
dinate  functions  .v,  and  .V;.  In  Fig.  la.  the  relative  position  of  the  points  is 
preserved  upon  projection,  and  we  may  view  FiA)  as  a  faithful  reconstruc¬ 
tion  of  the  attractor  A.  If  distinct  points  on  the  attractor  A  map  under  F 
to  distinct  points  on  F{A),  we  say  that  F  is  one-to-one  on  .-1. 

In  the  case  of  Fig.  lb.  on  the  other  hand,  two  difiereni  states  ot  the 
dynamical  system  have  been  identified  together  in  Ff.-l).  In  the  reconstruc¬ 
tion  space,  which  is  all  the  e.xperimenter  actually  sees,  the  two  distinct 
states  cannot  be  distinguished,  and  information  has  been  lost. 

The  one-to-one  property  is  useful  because  the  state  of  a  deterministic 
dynamical  system,  and  thus  its  future  evolution,  is  completely  specified  by 
a  point  in  phase  space.  Suppose  that  at  a  given  state  v  one  observes  the 
'.alue  n.v)  in  the  reconstruction  space,  and  that  this  is  followed  I  sec  later 
oy  a  particular  event.  If  F  is  one-to-one.  each  appearance  '1  the 
measurements  represented  by  Fix]  will  be  followed  1  -'CC  later  by  the  Name 
event.  This  is  because  there  is  a  one-to-one  correspondence  between  the 
attractor  points  in  phase  space  and  their  images  in  reconstruction  space 
There  is  predictive  power  m  finding  a  one-to-one  map. 

Perhaps  the  measurements  .ff.v)  would  not  be  repeated  precisely.  Net 
if  th^  Fis  reasonable,  similar  measurements  will  predict  similar  events. 
This  approach  to  prediction  and  noise  reduction  of  data  is  being  pursued 
by  a  number  of  research  groups. 

Although  most  of  the  interest  lies  in  the  case  that  ,1  is  an  attractor  of 
a  dynamical  system,  the  main  question  can  be  posed  in  more  generality 
Let  .-t  be  a  compact  subset  of  Euclidean  space  and  let  F  map  R‘'  lo 
another  Euclidean  space  R".  Cnder  what  conditions  can  we  be  assured  that 
■t  is  'embedded  "  m  R"  by  typical  maps  F’’ 

The  precise  definition  of  embedding  involves  dilfcrential  structure  \ 
one-to-one  map  is  a  map  that  docs  not  collapse  points,  that  is.  no 
points  are  mapped  to  the  same  image  point.  .\n  embedding  is  a  map  that 
does  not  collapse  points  or  tangent  directions.  Thus,  to  define  embedding, 
we  need  to  be  working  on  a  compact  set  .1  that  has  well-defined  tangent 
spaces. 

Let  I  be  a  compact  smooth  differentiable  manifold.  iHere.  as  in  the 
remainder  of  the  paper,  the  word  .smooth  will  be  used  to  mean  continuously 
differentiable,  or  C.)  A  smooth  map  F  on  .1  is  an  immersion  if  the 
derivative  map  DF(.v)  (represented  by  the  Jacobian  matn.x  of  F  at  v)  is 
one-to-one  at  every  point  .v  of  ,1.  Since  DFi.x)  is  a  linear  map.  this  is 
equivalent  to  DFf.x)  having  full  rank  on  the  tangent  space.  This  can  happen 
whether  or  not  F  is  one-to-one.  Under  an  immersion,  no  differential 
structure  is  lost  in  going  from  .-I  to  F(.-l). 
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An  cmheddine  of  /f  is  a  smooth  diffeomorphism  from  .-1  onto  us  image 
F(A).  that  IS.  a  smooth  one-to-one  map  which  has  a  smooth  inverse.  For 
a  compact  manifold  .-i.  the  map  F  is  an  embedding  if  and  only  if  F  is  a  one- 
to-one  immersion.  Figure  la  shows  an  e.xamplc  of  an  embedding  of  a  circle 
into  the  plane.  Figure  Ib  shows  an  immersion  that  is  not  one-to-one.  and 
Fig.  Ic  shows  a  one-to-one  map  that  fails  to  be  an  immersion. 

Whether  or  not  a  typical  map  from  .-1  to  R"  is  an  embedding  of  A 
depends  on  ihe  set  and  on  what  we  mean  by  'typical.  \  celebrated 
result  oi  this  type  is  the  embedding  genericity  theorem  ol  Whitney."'^’ 
which  says  that  if  .-1  is  a  smooth  manifold  of  dimension  d.  then  the  set  of 
maps  into  /?■*''' '  that  are  embeddings  of  A  is  an  open  and  dense  set  in  the 
C -topology  ‘if  maps. 

The  laci  that  the  set  of  embeddings  is  open  in  the  set  ol  smooth  maps 
means  that  gnen  each  embedding.  arDitrariU  ^mail  perturbations  will  still 
he  emocaaings.  The  laci  that  the  set  oi  emoeddings  is  licnsc  in  the  set  oi 
maps  means  that  every  smooth  map.  whether  it  is  an  emoedding  or  not.  is 
arbitrarily  near  an  embedding.  One  would  like  to  conclude  Irom  Whitney  s 


c 


Fig.  1  lal  An  embedding  F  of  the  smooth  manifold  .-1  into  R'  (b)  An  immersion  that  fails 
to  be  one-to-one.  (c)  A  one-to-one  map  that  fails  to  be  an  immersion. 
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theorem  that  n  =  2d+\  simultaneous  measurements  are  typically  sulficieht 
to  reconstruct  a  (/-dimensional  state  manifold  A  in  the  measurement 
space  /?". 

However,  open  dense  subsets,  even  of  Euclidean  space,  can  be  thin  in 
terms  of  probability.  There  are  standard  examples,  many  from  recent 
studies  in  dynamics,  of  open  dense  sets  that  have  arbitrarily  small  Lebesgue 
measure,  and  therefore  arbitrarily  small  probability  of  being  realized. 

A  well-known  example  is  the  phenomenon  of  .Arnold  tongues. 
Consider  the  family  of  circle  dilfeomorphisms 

)  =  V  +  to  +  A:  sin  .v  mod  2~ 

where  0  ^  lu  5. 2.*:  and  0  ^  A:  <  1  are  parameters.  For  each  k  we  can  define 
the  set 


StabiA- 1  =  0  ^  2*:  i,',,  ^  has  a  stable  periodic  orbit : 

For  0<A:<1.  the  ^et  Stab(A)  is  a  countable  union  of  disjoint  open 
intervals  of  positive  length,  and  is  an  open  dense  subset  of  [0.2.-]. 
However,  the  total  longt**  (Lebesgue  measur'^)  of  the  open  dense  set 
StabiA:)  approaches  zero  as  A:  -*0.  For  small  A-.  the  probaoility  of  landing 
in  this  open  dense  set  is  very  small.  See  ref.  3  for  more  details. 

With  such  examples  in  mind,  an  experimentalist  would  like  to  make  a 
stronger  statement  than  that  the  set  of  embeddings  is  an  open  and  dense 
set  of  smooth  maps.  Instead,  one  would  like  to  know  that  the  particular 
map  that  results  from  analyzing  the  experimental  data  is  an  embedding 
ivi7/i  prohahility  one. 

The  problem  with  such  a  statement  is  that  the  space  of  all  smooth 
maps  IS  infinitc-dimensional.  The  notion  of  probability  one  on  mfiniic- 
dimensional  spaces  doc'  •^oi  have  an  obvious  generalization  Irom  tlnite- 
dimensional  spaces.  is  no  measure  on  a  Banach  space  that 

corresponds  to  Lebesgue  measure  on  finite-dimensional  subspaces.  None¬ 
theless.  we  would  lilkc  to  make  sense  of  “almost  every”  map  having  some 
property,  such  as  being  an  embedding.  Following  ref.  24.  we  propose  the 
following  definition  of  prevalence. 

Definition  2.1.  A  Borel  subset  S  of  a  normed  linear  space  I'  is 
prevalent  if  there  is  a  finite-dimensional  subspace  E  of  1’  such  that  for  each 
f  in  V.  f-i-t'  belongs  to  S  for  (Lebesgue)  almost  every  c  in  E. 

We  give  the  distinguished  subspace  E  the  nickname  of  prohe  space. 
The  fact  that  5  is  prevalent  means  that  if  we  start  at  any  point  in  the 
ambient  space  V  and  explore  along  the  finite-dimensional  space  of  direc¬ 
tions  specified  by  £,  then  almost  every  point  encountered  will  lie  in  S. 
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Notice  that  any  space  containing  a  probe  space  for  S  is  itself  a  probe  space 
for  5.  In  other  words,  if  £'  is  any  finite-dimensional  space  containing  £. 
then  perturbations  of  any  element  of  V  by  elements  of  £’  will  be  m  5  with 
probability  one.  This  is  a  simple  consequence  of  the  Fubini  theorem.'**’ 

From  this  fact  it  is  easy  to  see  that  a  prevalent  subset  of  a  finite¬ 
dimensional  vector  space  is  simply  a  set  whose  complement  has  zero 
measure.  Also,  the  union  or  intersection  of  a  finite  number  of  prevalent  sets 
is  again  prevalent.  VVe  will  often  use  the  notion  of  prevalence  to  describe 
subsets  of  functions.  It  follows  from  the  definition  that  prevalent  implies 
dense  in  the  C*-topology  for  any  k.  More  generally,  prevalent  implies  dense 
in  any  normed  linear  space. 

When  a  condition  holds  for  a  prevalent  set  of  functions,  it  is  usually 
illuminating  to  determine  the  smallest,  or  most  efficient,  probe  subspace  E. 
This  corresponds  to  the  minimal  amount  of  perturbation  that  must  be 
available  to  the  system  in  order  for  the  condition  lo  hold  ■.'.iih  Mrtuai 
certainty. 

As  stated  above,  for  subsets  of  finite-dimensional  spaces  the  term 
prevalent  is  synonomous  with  “almost  every,"  in  the  sense  )f  outside  a  set 
of  measure  zero.  When  there  is  no  possibility  of  confusion,  we  wul  say  that 
“almost  every"  map  satisfies  a  property  when  the  set  of  such  maps  is 
prevalent,  oven  in  the  infinite-dimensional  case.  For  o.xample.  consider 
convergent  Fourier  senes  in  one  variable,  which  form  an  infinite-dimen¬ 
sional  vector  space  with  basis  ...  In  the  sense  of  prevalence, 

almost  every  Fourier  series  has  nonzero  integral  on  [0.2.-:].  The  probe 
space  £  in  this  case  is  the  one-dimensional  space  of  constant  functions.  If 
£'  is  a  vector  space  of  Fourier  series  which  contains  the  constant  functions. 
^  then  tor  every  Fourier  senes  /.  the  integral  vd'  /  -c  will  be  nonzero  for 
almost  every  e  in  £" 

With  this  definition,  we  introduce  a  prevalence  version  of  the  Whitney 
embedding  theorem. 

Theorem  2.2  (Whitney  Embedding  Prevalence  Theorem).  Let  .1  be 
a  compact  smooth  manifold  of  dimension  J  contained  in  /?*  Mmost  every 
smooth  map  R‘‘  —  '  is  an  embedding  of  .-1. 

In  particular,  given  any  smooth  map  F.  not  only  are  there  maps 
arbitrarily  near  F  that  are  embeddings,  but  in  the  sense  of  prevalence. 
almost  all  of  the  maps  near  F  are  embeddings.  The  probe  space  £  of 
Definition  2.1  is  the  k{2d  +  I  )-dimensional  space  of  linear  maps  from  £*  to 
This  theorem,  which  IS  proved  in  Section  4,  gives  a  stengthening  of 
the  traditional  statement  of  the  Whitney  embedding  theorem. 

It  is  quite  interesting  that  Whitney  later  proved  the  different  result  that 
under  the  same  circumstances,  there  exists  an  embedding  into  R^"^.  (This 
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could  be  called  the  Whitney  embedding  existence  theorem.  I  However,  an 
existence  theorem  is  of  little  help  to  an  experimentalist,  who  needs  inlorma- 
tion  about  maps  near  the  particular  one  that  happens  to  be  available. 
Knowledge  that  an  embeddirr  exists  sheds  little  information  on  the 
particular  F  under  study. 

The  example  of  Fig.  lb  shows  that  the  dimension  I./+1  ot 
Theorem  2.2  is  the  best  possible.  The  map  F  is  not  one-to-one  on  the 
twisted  circle  thus  does  not  embed  .-1  into  /?*.  Further,  no  nearby  map 
(even  in  the  C'"-topology )  embeds  .T  On  the  other  hand,  if  a  given  map  ot 
the  circle  .1  into  was  not  one-to-one.  there  would  necessarily  be  a 
prevalent  set  of  nearby  maps  that  arc  embeddings. 

The  tirst  mam  goal  of  this  section  was  .o  express  Whitney's  embedding 
theorem  (and  Takens'  theorem:  see  below i  in  this  probabilistic  sense.  The 
second  is  to  extend  Whitney's  theorem  to  sets  .1  that  are  not  manitoids 
Here  we  use  the  Iractal  dimension  known  as  box-counting  dimension, 

The  box-LOunting  lor  capacity  i  dimension  oi  a  compact  set  !  ;n  R  ' 
defined  as  lollows,  For  a  positive  number  ..  let  .1  be  the  set  ol  all  points 
within  ..  of  .1.  i.e.,  .1,  =  |.ve for  someuE.-l!.  Let  \ol(.I,) 
denote  the  //-dimensional  outer  volume  of  Then  he  h()\-^ounuiv< 
ilinK'iistun  of  .  I  is 

loevoK.l  ) 

boxdimi )  =  n-  urn  — - 

-0  logi. 

if  the  limit  exists.  If  not.  the  upper  (respectively,  lower!  box-counting 
dimension  can  be  defined  by  replacing  the  limit  by  (he  hm  ml  iresp., 
lim  sup).  When  the  box-counting  dimension  exists,  the  approximate  scaling 
law 


\  oil .  I  15:  ;. 


holds,  where  </  =  boxdimt.l  )• 

There  arc  several  equivalent  definitions  of  box-counting  dimension. 
For  example.  R"  can  be  divided  into  /.-cubes  by  a  grid  based,  say.  at  points 
whose  coordinates  .ire  /.-multiples  ol  integers.  Let  .VI/;)  be  the  number  ol 
boxes  that  intersect  I  Then 

loe  .V(/  I 

boxdtmi.l )  =  iim  — - 

,  -o  -loe,/' 


with  similar  provisions  for  upper  and  lower  box-counting  dimension.  The 
scaling  in  this  case  is 

/V(£)  ■' 
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Even  if  we  know  the  box-counting  dimension  of  an  attractor  A. 
Theorem  2.2  gives  no  estimate  on  the  lowest  dimension  for  which  almost 
every  map  is  an  embedding.  Suppose  we  know  that  .4  is  the  invariant  set 
of  a  flow  on  R"^.  and  that  the  box-counting  dimension  of  ,-1  is  1.4.  In  the 
absence  of  any  knowledge  about  the  containment  of  A  in  a  smooth 
manifold  ol  dimension  less  than  100.  the  use  of  Theorem  2.2  to  get  a  one- 
to-one  reconstruction  requires  the  use  of  maps  into  In  fact,  the 
smallest  smooth  manifold  that  contains  the  1.4-dimensional  attractor  may 
indeed  have  dimension  100.  But  as  the  next  result  shows,  one  can  do  much 
better:  almost  every  reconstruction  map  into  R^  will  be  one-to-one  on  .-1. 

Theorem  2.3  (Fractal  Whitney  Embedding  Prevalence  Theorem). 
Let  .1  be  a  compact  subset  of  /?*■'  ot  box-counting  dimension  </.  and  let  /i 
be  an  integer  greater  than  2J.  For  almost  every  smooth  map  /'  R*  —  R". 

1.  /•'  is  one-to-one  on  .( 

2.  F  is  an  immersion  on  each  compact  subset  C’  of  a  smooth  manifold 
contained  in  .1.. 

The  proof  of  the  one-to-one  half  o  the  fra»‘.al  Whitney  embedding 
prevalence  theorem  may  be  sketched  as  follows.  Choose  any  bounded 
finite-dimensional  space  £  of  smooth  maps  Fso  that  varying  Fhy  elements 
of  £  results  in  perturbing  £(.v)  -  Fly)  throughout  /?"  for  each  pair  v  i'  in 
/(.  For  example,  the  probe  space  £  can  be  taken  to  be  the  space  of  linear 
maps  from  R*  to  £".  Then  the  probability  (measured  in  £)  that  the 
perturbed  F(  vi  and  £(  r)  lie  within  ;;  is  on  the  order  of  i:".  Similarly,  if  B, 
and  are  i -boxes  on  .1.  the  probability  that  and  intersect  is 
on  the  order  of  j;".  Here  we  assume  that  there  is  a  bound  on  the  magnifica¬ 
tion  ol  F.  as  when  F  is  a  smooth  map  near  the  compact  set  !  The  set  I 
can  be  covered  by  essentially  i.  ‘  boxes  ol  size  ...  anu  the  number  oi  pairs 
of  boxes  is  proportional  to  i;:  The  probability  that  no  distinct  pair  of 

boxes  collide  in  the  image  F(A}  is  proportional  to  (<:  "'M ■/;''=  c' ' If 
ft  >  ZJ.  this  probability  of  choosing  a  perturbation  of  F  that  fails  to  be  one- 
to-one  IS  negligible  for  small  i..  More  precise  details  of  the  proof,  as  well  as 
the  immersion  part,  are  m  Section  4 

2.2.  Fractal  Delay  Embedding  Prevalence  Theorem 

Despite  the  beauty  of  Whitney  s  embedding  theorem,  it  is  rare  for  a 
scientist  to  be  able  to  measure  a  large  number  of  independent  quantities 
simultaneously.  In  fact,  it  is  a  rather  subtle  problem  to  decide  whether  two 
different  simultaneous  measurements  are  indeed  independent.  These 
problems  can  be  sidestepped  to  some  degree  by  introducing  the  use  of 
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delay  coordinaies.  In  this  approach,  only  one  measurable  quantity  is 
needed. 

In  a  typical  experiment,  the  single  measurable  quantity  is  sampled  at 
intervals  T  time  units  apart.  The  resulting  list  ot’  samples  \Q,\  is  called  a 
time  series.  Think  of  the  measurable  quantity  as  an  observation  function  h 
on  the  state  space  /?*  on  which  the  dynamical  system  is  acting.  Each 
reading  Q,~ln.x,)  is  the  result  of  evaluating  the  observation  function  It  at 
the  current  state  .v.. 

Oefinition  2.4.  If  0  is  a  llow  on  a  manifold  A/.  T  is  a  positi\o 
number  (called  the  dclayi  and  In  .U—  /?  is  a  smooth  function,  define  the 
delay-ionrdinaie  map  Fill.  0.  T):  A/  —  R”  by 

F(/i.  0.  ni.Y!  =  (/;(. VI. /i(0  ,i.vn.//(0  . /t(0  „.,,/lYll) 

To  start  with  a  simple  example,  let  I  be  a  periodic  orbit  01  the  i1o\k 
0  We  lound  above  that  in  the  aosence  01  dynamics,  three  muenenueni 
coordinates  are  required  to  embed  I  in  reconstruction  ^pace.  'r  more 
precisely,  that  .ilmosi  every  smooth  map  r=i/,,/v./;)  from  i 
neighborhood  of  .-I  to  /?'  is  an  embeddin  *  on  .1. 

Now  the  situation  is  dif.crent.  Instead  of  three  functions  /  , .  /;•.  / ,  that 
must  be  independent,  there  is  a  single  function  /i.  and  the  corresponding 
map  Fill.  0.  T)  pictured  in  Fig.  d.  We  want  to  know  that  for  almost  c\ery 
function  h  from  ,1  to  the  real  numbers  R.  the  delay-coordinate  map 
Fdi.  0.  T)  from  .(  into  R"  is  an  embedding.  It  should  be  stressed  thai  this 
docs  not  follow  from  Theorems  2.2  and  2.3.  The  maps  Fili.<P.  D  form  a 
restricted  subset  of  all  maps:  whether  they  contain  enough  \ariaiion  to 
perturb  away  self-crossings  of  .d  needs  to  be  determined.  In  fact,  the  general 


Fig.  2.  The  attractor  on  the  left  is  mapped  using  delav  coordinates  into  the  reconstruction 

space  on  the  right. 
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answer  is  that  they  do  not  contain  enough  variation.  E.xtra  hypotheses  on 
the  dynamical  system  0  are  required  to  ensure  that  almost  every  h  leads  to 
an  embedding  of  A. 

To  see  the  need  for  e.xtra  hypotheses,  consider  the  case  tha'  ,  is  a 
periodic  orbit  of  a  continuous  dynamical  system  whose  period  is  equal  to 
the  sampling  interval  T.  Topologically.  .-1  is  a  circle.  In  this  case.  F(/i,  <P,  T) 
cannot  be  one-to-one  for  any  observation  lunction  h.  Let  v  be  a  point 
on  the  topological  circle  I.  Since  the  period  of  .1  is  T.  h{x)- 
h{0  ,iAi)=  a/n0  so  that  F=F{h.0.  T)  maps  .v  to  the 

diagonal  line  ;(.v, . v,);  .v,  =  •  =  .v,l  in  /?".  .A  circle  cannot  be  mapped 

continuously  to  a  line  (in  this  case,  the  diagonal  line  in  /?")  in  a  one-to-one 
fashion.  See  Fig.  3. 

The  one-to-one  property  also  fails  when  is  a  periodic  orbit  of  period 
IT.  Detmc  the  function  i/i.vi  = /'ii.vi  - 'M0  on  .1.  The  lunction  a  is 
cither  identicailv  zero  or  it  is  nonzero  lor  some  .v  on  .L  in  which  case  it  has 
the  opposite  Mgn  at  the  image  point  0  ./i.v).  and  changes  sign  on  .1.  In 
any  case.  </|.t)  has  a  root  .v„  on  .1.  Since  the  period  of  .1  is  2T.  we  have 
/»(.Vo)  =  A(0  ,{Xn))-h{0  ••  Then  FHu0,T)  maps  and 

0  /(.to)  to  the  same  point  in  ^  .  If  .Vo  and  0./i.Vo)  are  distinct,  this 
says  that  F  is  not  one-to-one.  If  v,,*  0  .  ,(.to),  then  the  orbit  actually  has 
period  T.  ard  f  fails  to  be  one-to-one  as  above.  In  the  presence  of  periodic 
orbits  of  period  27.  ff/i.  0.  T)  cannot  be  one-to-one  for  any  observation 
function  h. 

On  the  other  hand,  when  .1  is  a  periodic  orbit  of  period  37.  or  any 
period  not  equal  to  7  or  27.  there  is  no  such  problem.  In  this  case  the 
delay-coordinate  map  of  a  periodic  i>rbit  .1  into  /?”  is  an  embedding  for 
almoM  every  iibscrvaiion  lunction  n  .li  long  as  ihe  reconstruction  dimen- 
^lon  i-i  at  least  three.  The  Matcment  :or  more  eenerai  attractors  I  is 
follows. 


T 


R 


Fig.  3.  A  two-io-one  map  from  a  topological  circle  to  the  real  line. 
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Theorem  2.5  (Fractal  Delay  Embedding  Prevalence  Theorem i. 

0  be  a  flow  on  an  open  subset  C  of  /!*.  and  let  .-I  be  a  compaa  subset  of 
C  of  box-counting  dimension  a.  Let  n>2J  be  an  integer,  and  let  T>i). 
Assume  that  A  contains  at  most  a  finite  number  of  equiiibrix  no  periodic 
orbits  of  of  period  T  or  IT.  at  most  '^-itely  many  periodic  orbits  I'l 
period  IT.  AT.....  nT.  and  that  the  linearizations  of  those  periodic  orbits 
have  distinct  eigenvalues.  Then  for  almost  every  smooth  function  h  on  i\ 
the  delay  coordinate  map  f(/i.  <P.  TV.  L'  —  /?"  is; 

1.  One-to-one  on 

2.  An  immersion  on  each  compact  subset  C  •'!  a  smooth  manifold 
contained  in  A. 

Where  Takens  *  ’  showed  that  the  delay-coordinate  maps  cencricaliy 
I  in  the  C  '-topology  i  give  embeddings  of  smooth  manifolds  oi  dimension  J. 
AC  substitute  compact  sets  of  box-countmg  ■.iimension  ...  .md  rjoiacc 
genenc  with  prevalent. 

The  assumption  of  Theorem  Z.5  that  there  arc  no  penodic  orbits  -  i 
period  T  or  27  can  be  satisfied  by  choosing  the  time  delay  f  to  bo 
sufficiently  small.  In  fact,  ii  we  assume  that  the  vecto*'  field  on  A  satisfies 
a  Lipschitz  condition,  that  is.  .v=r(.vK  where  I'f.vl- !'( i  Ji  ^  L..v  -  ; 
then  It  is  known*'®*  that  each  periodic  orbit  must  have  period  at  least  Zr  L. 
Hence,  if  7<  rc;L.  there  will  be  no  periodic  orbits  t>f  period  7  <'r  27 

Theorem  2.5  assumes  n>Zd  to  avoid  'clf-intcrscction  of  the 
reconstructed  ipiage  of  .1.  To  see  that  this  requirement  cannot  he  rcia.xcd 
in  general,  consider  the  case  J=!.  n~Zd=Z  shown  in  Fig.  4a.  Let  the 
observation  function  h  be  the  coordinate  function  v,.  and  consider  the 
delay  coordinate  map  /?*  —  /?*  defined  by 

\ \  I.  \  ,10  viii 

In  the  situation  illusw  ...wU  in  Fig.4a.  \A(P  ,(uH< 

v,lu)  =  and  \A<P  ;u))<v,t0  ,(</))<  \  ,(t  )=  Selling 

F(.v,.0.  7).  this  means  that  m  the  reconstruction  ^pace  /?’.  Ra)  lies 
directly  above  Fih).  and  Fid)  lies  directly  .’hove  F{i  ]  See  Fig.  4b.  The  map 
F  is  continuous  on  the  traieciory.  there  is  a  continuous  path, 
parametrized  by  v,.  connecting  F(a]  and  Ht  i.  There  is  also  such  a  path 
connecting  F(h)  and  Fid),  .\ccording  to  Fig.  4b.  there  must  be  a  \alue  of 
V,  in  between  where  the  curves  meet,  and  two  different  points  on  ihe  circle 
map  'ogether  under  F  Otherwise  said,  somewhere  in  between  there  is  an 
V,  coordinate  such  that  the  upper  and  lower  parts  of  the  trajectory  advance 
the  same  amount  in  the  .v,  direction  during  the  time  interval  7.  and  thus 
have  identical  delay  coordinates.  The  map  Filu  0.  T)  is  not  an  embedding. 
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If  ths  obsemtion  function  or  flow  is  psnurbed’  a  small  amounL  the  same 
topoiogi::ai  argument  can  be  made.  Thus,  this  example  is  robusL  No  small 
perturbation  of  the  map  is  an  embedding. 

Theorem  2.5  is  a  special  case  of  a  statement  about  difleomorphisms. 
Before  stating  that  version,  we  redefine  delay  coordinate  maps  for 
difleomorphisms. 

Definition  2.6.  If  g  is  a  difleomorphism  of  an  open  subset  L'  of  /?*'. 
and  h:  L  —  /?  is  a  function,  define  the  liclay  coordinaic  map  Fill,  c  j:  C  —  R" 
by 

Fill,  g  i.v  =  1  /i(.t ).  hi  gf  v  I ).  hi  g-j  v  1 1 hi  g'-  ■  ’  i  ,v )  1 1 


Fig.  4  (a)  A  trajectory  of  a  flow  that  cannot  be  mapped  using  two  delay  coordinates  in  a 

one-to-one  way.  (b)  The  point  at  which  the  paths  cross  corresponds  to  a  set  of  delay  coor¬ 
dinates  shared  by  two  points  on  the  trajectoi  v 
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We  ^  the  previotis  theorem  by  substituting  g  =  ^  in  the  folbwing 

statement 

Theorem  2.7.  Let  g  be  a  diSeomorphism  on  an  open  subset  i'  of 
R* .  and  let  .-I  be  a  compact  subset  of  C.  boxdimi.-i » =  </.  and  let  n>lJ  he 
an  integer.  Assume  that  for  every  positive  integer  p^n,  the  set  .t,  of 
periodic  points  of  period  p  satisfies  boxdimi.-l;.)< /7  2.  and  that  the 
linearization  Dg^  for  each  of  these  orbits  has  distinct  eigenvalues. 

Then  for  almost  every  smooth  function  /;  on  L'.  the  delay  coordinate 
map  fY/i.  g):  V  RT  is; 

1.  One-to-one  on  A. 

2.  An  immersion  on  each  compact  subset  C  of  a  smooth  manifold 
contained  in 

Remark  2.8.  The  probe  space  lor  this  prevalent  set  can  he  i.ikcr.  ii' 

■’e  any  set  h . ii.  oi  polynomials  in  k  vanaoles  unich  includes  aii  roivno- 

mials  ol  total  degree  up  to  In.  (.}iven  any  smooth  function  /; .  vm  I  . 
lor  almost  all  choices  iif  -j£  =  ta,  .... 2,1  from  R'.  the  function  /,= 
=  i  satisfies  properties  1  and  2. 

Remark  2.9.  The  proof  of  Theorem  2.7  is  easily  e.xtended  to  the 
more  general  case  where  the  reconstruction  map  F  consists  of  a  mixture  of 
lagged  observations.  The  more  general  result  says  that 

f(.Y  I  =  ( /i ,  ( .V ) h ,  ( g”'  -'{.VI  I /;„(  .\  I h  ,1  g  ' '  '  ( .V ) ) ) 

satisfies  the  conclusions  of  Theorem  2.7  as  long  as  //,  4-  -rn  ,  ;■  2J  and 
the  corrc',ponding  conditions  on  the  periodic  points  arc  satisfied.  Those 
conditions  arc  that  boxdimi  .4  p  2  for  p  •  •  max  ;  n , ...... '/ ,  | 

The  reconstruction  of  cha  •tractors  using  independent  courdinaics 
from  a  time  senes  was  advocatcu  iii  i9S0  by  Packard  ci  jL''"  The  delay- 
coordinate  map  is  attributed  in  that  work  to  a  communicauon  uith 
D.  Ruelle.  The  metho  .ctually  illustrated  in  ref..  21  is  somewhat  different; 
namely,  it  is  to  use  the  value  u,  of  the  time  series  and  its  time  derivaiues 
as  independent  coordinates. 

In  1981.  Takens'-'’’  published  the  first  mathematical  results  on  ihe 
delay-coordinate  map.  Around  the  same  lime.  Roux  and  Swmne> 
exhibited  plots  of  delay-coordinate  reconstructions  of  experimental  data 
from  the  Belousov-Zhabotinski  reaction. 

In  1985.  Eckmann  and  Ruelle''"  took  the  idea  one  step  further  and 
suggested  examining  not  only  the  delay  coordinates  of  a  point,  but  also  the 
relation  between  the  delay  coordinates  of  a  point  and  the  next  point  which 
occurs  T  time  units  later.  In  principle,  one  can  then  approximate  not  only 
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the  attractor,  but  the  attraaor  together  with  its  dynamics.  Since  ref.  9  it  has 
become  common  practice  to  gath  er  points  that  are  close  in  reconstruction 
space,  and  use  their  next  images  to  construct  a  low-order  parametric  model 
which  approximates  the  dynamics  in  a  small  region.  This  idea  has  begun 
to  be  used  for  prediction  and  noise  reduction  applications.  See.  for 
example,  refs.  1.  6.  11  13.  15.  16.  18.  and  28. 

2.3.  Self-Intersection 

In  the  case  that  the  reconstruction  dimension  n  is  not  greater  than 
twice  the  box-counting  dimension  cl  of  the  set  A.  the  map  F  in  the  fractal 
Whitney  embedding  prevalence  theorem  (Theorem  2.3)  will  often  not  be 
an  embedding.  However,  if  ci<n,  most  of  A  will  still  be  embedded.  In  the 
case  that  .(  is  a  smooth  manifold  of  dimension  cl.  almost  every  F  will  be 
an  embedding  outside  a  subset  of  A  of  dimension  at  most  2.1  -  >/.  If  d  <  n. 
then  2J-n<cl.  and  so  this  exceptional  subset  will  have  positive  codimen¬ 
sion  in  A. 

If .(  is  simply  a  compact  set  of  box-counting  dimension  </,  then  the 
situation  is  slightly  different.  We  will  call  the  pair  .v.  y  of  points  6-clistani 
if  the  distance  between  them  is  at  least  6.  Then  we  define  the  d-clistam  self- 
miersection  sci  of  F  to  be  the  subset  of  A  consisting  of  all  a  such  that  there 
is  a  d-distant  point  y  with  Fix)  =  Fiyy,  that  is. 

HF.  ())  =  Jag  Fix)  =  Fiy)  for  some  i  g  Ja  -  .m  ^  d J 

Then  the  result  is  that  for  every  .i  >  0.  the  lower  box-counting  dimension 
of  the  d-distant  self-intersection  set  TfF.  d)  is  at  most  ZJ-n  for  almost 
every  F.  \  precise  statement  is  given  by  the  next  theorem. 

Theorem  2.10  (Self-Intersection  Theorem).  Let  .(  be  a  compact 
subset  of  of  box-counting  dimension  cl.  let  n  ^  2cl  be  an  integer,  and  let 
d  >  0.  For  almost  every  smooth  map  F:  R‘'  —  /?": 

1.  The  d-distant  self-intersection  set  liF.d)  of  F  has  lower  box¬ 
counting  dimension  at  most  Zd-n. 

2.  F  is  an  immersion  on  each  compact  subset  C  of  an  /u-manifold 
contained  in  .I  except  on  a  subset  of  C  of  dimension  at  most 
2m  — n-  1 . 

For  example,  consider  mapping  a  circle  to  the  real  line.  In  this  case 
d=m  =  n=  \,  and  Theorem  2.10  says  that  a  prevalent  set  of  fare  immer¬ 
sions  outside  a  zero-dimensional  set.  This  is  clear  from  Fig.  3.  where  the 
zero-dimensional  set  consists  of  a  pair  of  points.  The  map  is  at  least  2  to 
I  outside  this  set.  and  hence  nowhere  an  embedding. 
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On  the  other  hand,  setting  </ = m  =  I  and  «  =  2  in  the  theorem,  we  see 
that  a  prevalent  set  of  maps  F  from  the  circle  to  the  plane  are  immersions, 
and  are  embeddings  outside  a  zero-dimensionai  subset.  Thus,  the  maps 
shown  in  Figs,  la  and  lb  arc  of  the  prevalent  type,  immersions  v.-hich  are 
one-to-one  except  for  at  most  a  discrete  (zero-dimensionail  set  ol  pouits. 
Figure  Ic.  on  the  other  hand,  is  nonprevalent.  Almost  any  map  near  F  will 
perturb  away  the  cusp. 

There  is  also  a  oclf-intersection  version  of  the  fractal  delay  embedding 
prevaience  theorem  (Theorem  2.5)  which  one  gets  by  making  the  obvious 
changes.  Thus,  if  /i$  Jj.  then  for  each  o  >0  there  exists  a  subset  1[F.  oi. 
whose  box-counting  dimension  is  at  most  Zd—n.  on  which  the  delay- 
coordinate  map  fails  to  be  one-to-one.  Note  that  the  result  is  independent 
of  t>>0.  If  M  is  a  closed  subsed  of  an  /»-manifold  contained  in  .1.  then 
there  is  a  subset  £,  of  St  of  dimension  at  most  Zm  —  n—  I  on  uhich  the 
map  fails  to  be  an  immersion. 

2.4.  How  Many  Delay  Coordinates  Do  You  Need? 

When  using  a  delay  coordinate  map  (or  filtered  delay  coordinate  map. 
described  in  the  next  seciic*  )  to  examine  the  image  ff.-l)  in  R”  ot  a  ^ei  .1 
in  /?*.  the  choice  of  n  depends  on  the  objective  of  the  investigation. 
Different  choices  of  n  suffice  for  the  different  goals  of  prediction,  calculation 
of  dimension  and  Lyapunov  exponents,  and  the  determination  v'l  the 
stability  of  periodic  orbits. 

To  compute  the  dimension  of  .1.  all  that  is  required  is  that 

dim  F(.-l )  =  dim  .1  '-•11 

whether  the  dimension  being  used  is  box-counting.  Hausdortf.  iniorm.uion. 
or  correlation  dimension.  The  latter  two  depend  on  a  probability  density 
on  .d  and  Fl.-l).  It  is  shown  in  ref.  24  that  for  the  case  ot  Hausdortf  dimen¬ 
sion.  the  equality  (2.1)  holds  for  almost  every  measurable  map  m  the 
sense  of  prevalence,  as  long  as  /j^dimi.l).  The  probe  space  of  perturba¬ 
tions  for  this  result  is  the  space  of  all  linear  transformations  from  /?*  to  R 
Mattila"'^'  proved  that  equality  (2.1)  holds  for  almost  every  orthogonal 
projection  F. 

It  is  newhat  surprising  that  there  are  exampi.’S  tor  which  iZ.I )  does 
not  hold  lor  any  map  F  when  box-counting  dimension  is  used.  e\en  under 
the  hypothesis  n  >  boxdimi.-l ).  An  example  of  this  type  is  given  in  rel. 
However,  in  most  cases  of  compact  sets  which  arise  in  dynamical  svsten.s. 
we  expect  Hausdorff  dimension  to  equal  box-counting  dimension. 

In  pr  ical  situations,  if  attempts  to  measure  boxdimi.-l)  result  in 
answers  dependent  on  n.  where  n  >  boxdim(.-l).  then  the  \anation  would 
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seem  to  be  a  numerical  artifact,  since  there  is  no  theoretical  justification  for 
which  of  the  values  of  n  greater  than  boxdimi.4)  gives  the  more  accurate 
result  The  usual  technique  is  to  increase  n  until  the  observed  dimension  of 
boxaim  Ff.-I)  reaches  a  plateau,  and  to  use  this  result  The  resulting 
number  might  be  called  the  piateau  dimension.  While  the  plateau  dimension 
may  indeed  give  the  best  numencal  estimate  of  the  dimension  of  ,4.  there 
does  not  seem  to  be  theoretical  or  numerical  Justification  of  this  bias,  and 
the  question  needs  further  investigation.  Notice  that  /i  >  boxdimi  .4 1  does 
oot  guarantee  that  almost  every  F  is  one-to-one.  but  that  is  not  required 
for  dimension  calculation. 

If  the  objective  is  to  use  F(A )  to  predict  the  future  behavior  of  trajec¬ 
tories.  then  it  is  sufficient  to  have  the  map  F  be  one-to-one.  m  which  case 
n>l  boxdimi .4 )  is  needed.  Knowing  the  current  state  in  fi  4  i  is  sufficient 
to  predict  the  luture  of  the  trajectory  lat  least  in  the  ^ho^t  rum.  In  the 
Mtuation  Fig.  lb.  on  the  other  hana.  prediction  on  the  periodic  oroit  i 
would  'jtilt  he  possible,  except  when  the  trajectory  was  at  the  midpoint  (M 
the  "figure  eight,” 

If  the  objective  ,s  to  compute  the  Lyapunov  exponents  of  the  system, 
it  is  necessary  to  ask  which  exponents  are  to  be  con  .juted.  For  a  simple 
example,  suppose  the  attractor  .4  is  a  periodic  orbit.  Then  the  best  possible 
result  ol  the  examination  of  Ff.4l  is  to  observe  that  i)  is  a  Lyapunov 
exponent.  The  other  exponents,  presumably  all  negative,  cannot  be 
observed  without  introducing  perturbations.  More  generally,  if  an  attractor 
.4  lies  on  a  manifold  of  dimension  m  las  a  2.2-dimensional  attractor  might 
lie  on  a  three-dimensional  manifold),  it  will  certainly  he  impossible  to 
measure  more  than  m  true  exponents  from  an  embedding,  even  if  the 
reconstructed  image  Tf.l)  lies  in  R"  with  n>in.  There  are  no  criteria  for 
determining  the  smallest  manifold  containing  .1 

Theorems  2.3  and  2.5  say  that  if  n>  2  ■  boxdimi.  1 ).  then  almost  every 
F  is  an  embedding  of  all  smooth  manifolds  that  lie  in  .1.  The  smooth 
manifolds  we  have  in  mind  are  the  surface  corresponding  to  the  unstable 
directions  on  the  attractor  .1.  that  is.  the  unstable  manifolds.  Under  an 
embedding,  the  differential  information  is  preserved  along  smooth  direc¬ 
tions,  such  as  unstable  manifolds,  indicating  that  positive  Lyapunov 
exponents  should  be  computable  from  the  image  n.4). 

The  stable  manifolds,  on  the  other  hand,  will  be  likely  lo  intersect  .1 
in  a  Cantor  set.  The  image  of  a  Cantor  set  in  Ff.4l  may  he  quite  com¬ 
pressed.  For  example,  a  set  which  is  the  product  of  five  Cantor  sets  whose 
dimensions  sum  to  0.5  might  be  mapped  to  a  one-dimensional  line  in  f(.4 ). 
It  seems  difficult  to  recover  any  exponents  in  these  directions  from 
knowledge  of  the  reconstructed  dynamics  m  F(A ). 

The  self-intersection  results  in  Section  2.3  are  aimed  at  another  kind  of 


596 


Sauer  er  a/. 


question.  A  relevant  experiment  involving  a  vibrating  nbbon  is  described  in 
refs.  8  and  26.  In  this  case,  the  Poincare  map  has  an  attractor  whose 
dimension  was  experimentally  calculated  to  be  1 .1  The  investigators  were 
interested  in  determining  the  eigenvalues  of  the  iineanzation  of  a  period-3 
point  on  the  attractor. 

Using  a  delay-coordinate  map  of  the  attractor  into  /?’  did  not  result 
in  a  one-to-one  map,  which  is  consistent  with  our  results  in  Section  2.2. 
Theorem  2.10  of  Section  2.3.  which  deals  with  self-intersection,  suggests 
that  the  subset  I  of  A  on  which  the  map  into  R'  fails  to  be  one-to-one 
should  have  dimension  at  most  Zd-n  =  2x  1.2 -2  =0.4.  They  found  that 
the  self-intersection  set  looked  like  a  finite  set.  If  I  indeed  has  dimension 
0.4  or  less,  as  we  w».!.;  i  expect,  then  the  set  I  would  be  unlikely  to  include 
the  periodic  point  in  question,  and  the  delay-coordinate  map  would  be 
expected  to  be  one-to-on'*  in  a  neighborhood  of  that  orbit.  Numerical 
investigations  of  the  dynamics  near  the  periodic  orbit  revealed  iliai  the 
dynamics  did  appear  to  be  two-dimensional,  and  the  researchers  uere  aoie 
to  estimate  numerically  the  eigenvalues  of  the  orbit  at  these  points. 

3.  THE  DELAY  COORDINATE  It/lAP  AN  J  FILTERS 
3.1.  Main  Results 

So  far.  we  have  defined  the  delay  coordinate  map  .v  —  f(/i.  ci  v  from 
the  hidden  phase  space  /?*  to  the  reconstruction  space  R".  Under  suitable 
conditions  on  the  diffcomorphism  the  delay  coordinate  map  Tl//.  ci  is 
an  embedding  for  almost  all  observation  functions  It.  In  this  formulation, 
information  from  the  previous  n  time  steps  is  used  to  identify  a  state  of  the 
original  dynamical  system  in  /?U 

For  purposes  of  measuring  quantitative  invariants  of  the  d\namicai 
systems,  noise  reduction,  or  prediction,  it  may  he  advantageous  to  create 
an  embedding  that  identifies  a  state  with  information  from  a  larger  number 
of  previous  time  steps.  However,  working  with  embeddings  in  R"  is  difficult 
for  large  n.  A  way  around  this  problem  is  to  incorporate  large  numbers  of 
previous  data  readings  by  ''averaging"  their  contributions  in  some  sense. 
This  problem  has  also  been  treated  in  ref.  7 

To  this  end.  generalize  the  delay-coordinate  map  F(/i.  R^  -  R"- 

F{ /i,  g  I  .V  =  ( li{  .V ).  Ii{  .V  i ) . /i(  g"  ■ '  ( .V ) ) ) '" 

where  the  superscript  T  denotes  transpose,  by  defining  the  ftliercd  ilelav- 
coordinate  map  F{  5.  /i.  g):  /?*  —  R"  to  be 

F{BJi,g)x  =  BFUu  g)x 


(3.1) 
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where  B  is  an  n  x  w  constant  matrix.  Thus,  each  coordinate  of  H5.  lu  g)x 
IS  a  linear  combination  of  the  n  coordinates  of  F(lug).x.  Here  we  are 
considenng  the  case  where  g  is  a  diffeomorphism.  for  notational 
convenience.  Everything  we  say  applies  to  a  flow  by  setting  g  equal  to 
the  time  -  T  map  of  the  flow.  We  will  call  u  the  w  indow  length  of  the 
reconstruction,  since  there  are  w  evenly-spaced  observations  used.  We  call 
n  the  reconstruction  dimension,  since  R"  is  the  range  space  of  the  map.  We 
may  as  well  assume  that  n  $  u-  and  that  B  has  rank  n:  otherwise  we  could 
throw  away  some  rows  of  B  without  losing  information.  .Assuming  that  B 
IS  a  fixed  matrix  restricts  the  filter  to  be  a  linear  multidimensional  moving 
average  iMA)  filter.  .Autoregressive  lAR)  filters  in  general  can  change  the 
dimension  of  the  attractor.'"* 

If  B  is  the  identity  matrix  (denoted  /).  the  map  is  the  original  Takens 
delay  coordinate  map.  \s  stated  in  the  previous  section,  m  that  case. 
Fil.  Ii,  1')  =  nil.  g)  IS  almost  alwavs  an  embedding  as  long  .u  n  is  greater 
than  twice  the  box-counting  dimension  of  the  attractor  and  the  periodic 
points  of  period  p  less  than  n  have  distinct  eigenvalues  and  make  up  a  set 
of  boxdim  < 

Under  fih:rmg,  some  complications  are  caused  by  the  existence  of 
periodic  cycles.  On  the  other  hand,  the  next  theorem  states  that  in  the 
absence  of  cycles  of  length  smaller  than  the  window  length  n.  every  moving 
average  filter  B  gives  a  faithful  representation  of  the  attractor. 

Theorem  3.1  ( Filtered  Delay  Embedding  Prevalence  Theorem  i. 
Let  U  be  an  open  subset  of  g  be  a  smooth  diffeomorphism  on  C.  and 
let  .1  be  a  compact  subset  of  L\  boxdimi.l)  =  </.  For  a  positi\e  integer 
II  >  Id.  let  B  be  an  n  x  u  matrix  of  rank  ii.  .Assume  c  has  no  periodic  points 
>>1  period  less  than  or  equal  to  u  Then  lor  almost  c\erv  smooth  function 
/'/.  the  delay  coordinate  map  hB.  ii.  gy.  L  —  R"  is. 

1.  One-to-one  on  .1. 

2.  .An  immersion  on  each  closed  subset  ('  of  a  smooth  manifold 
contained  in  .T 

The  probe  space  for  perturbing  li  can  be  taken  to  be  any  space  of  poly¬ 
nomials  in  k  variables  which  includes  all  polynomials  of  total  degree  up  to 
2iv.  Furthermore,  in  case  n^2d.  the  results  of  Theorem  3.1  hold  outside 
exceptional  subsets  of  ,-1  precisely  as  in  Theorem  2.10. 

For  example,  consider  the  3  x  9  matrix 

(\  ^  i  0  0  0  0  0  0\ 

5=  0  0  0  t  i  i  0  0  0 

\0  0  0  0  0  0  I  i 


(3.2) 
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Then 


F( B,  h.  ) .r  =  ( ^( h{ x )  +  hi  ))-r  hi  ,?*( .v  I ) ). 

:( //( if  'i  Y I )  +  /,( ij-'f  .V ) )  +  hi  e- ( .V I ) ), 

T(/M,if"(  vl )  +  //(. ir't.Yl)  +  /j|,r'(.v)))) 

Although  the  map  FiB.h.a)  uses  information  from  9  different  lags,  the 
■'moving  average"  reconstruction  space  is  only  3'dimensionai.  According  to 
the  theorem,  if  the  dynamical  system  ir  has  no  periodic  points  of  period  loss 
than  11=9.  then  F(B.h,<;)  is  an  embedding  for  almost  all  observation 
functions  /;. 

Remark  3.2.  When  the  diffeomorphism  e  has  periodic  points, 
certain  special  choices  of  fillers  B  will  cause  soif-intcrseciion  to  occur  .it  tiic 
periodic  points.  However,  under  the  genericuy  hypotheses  on  the  oonami- 
cal  system  of  Theorem  2.5.  for  example,  almost  all  choices  of  an  n  <  u 
matrix  B  imply  the  conclusions  of  Theorem  3.1.  This  follows  from  Remarks 
3.4  and  j.j.  A  more  detailed  view  of  the  effect  of  periodic  points  I'f  the 
dynamical  system  is  given  in  Sections  3.3  and  3.4. 


3.2.  Examples  of  Filters 

In  this  section  we  will  list  some  examples  of  filters  that  may  he  useful 
in  given  situations.  The  easiest  example  is  a  simple  averaging  filter.  For  any 
integers  /».  n.  let  B  be  a  /i  x  nut  matrix  of  form 

/ \  ni-  I  ni 


\  I 'm • • • 1  ntj 

where  there  are  m  nonzero  entries  in  each  row.  In  the  presence  of  noise, 
this  filter  should  perform  well  compared  to  the  more  standard  dclav -coor¬ 
dinate  embedding  which  uses  every  »ith  reading  and  discards  the  rest. 

A  more  sophisticated  noise  filter  was  suggested  in  ref.  5  for  a  slight!) 
different  purpose,  and  elaborated  on  in  the  very  readable  ref.  2.  where  ii  is 
used  for  dimension  measurements.  It  is  based  on  the  singular  value  decom¬ 
position  from  matrix  algebra,  also  known  as  principal  component  analysis. 
Let  .I'l . Xl  be  the  reconstructed  vectors  in  R".  where  L  is  the  length  of  the 
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data  senes.  Following  Broomhead  and  King,'*’  define  the  L  x  w  irajeciory 
matrix 


where  the  i are  treated  us  row  vectors.  The  lovanance  mainx  of  this 
multivariate  distribution  ts  .-I'.-l.  The  oiT-diagonal  entries  of  .-I'.-l  measure 
the  statistical  dependence  of  the  variables. 

The  Mngular  value  decomposition' of  the  L  <\v  matrix  where 

L  ^  lb 

% 

\  =  i3.4l 

where  i  ^  an  /.  •  /,  orthogonal  matrix,  i  ib  a  u  x  n  orthogonal  matrix 
I  this  means  that  V'(.'  =  /l.  and  is  an  ^  •  u  diagonal  matrix 

tmcaning  that  the  entries  c.,  of  S  arc  zero  if  /).  By  rearranging  the  rows 
and  columns  of  C  and  r.  we  can  arrange  for  the  .vmi»«/ur  laluvs  of.i  to 
satisfy  fXj;  5;  •  •  -  ^  >  0.  The  bottom  L  -  >»■  rows  of  5  are  zero. 

The  singular  value  decomposition  suggests  the  use  of  the  filter  r'’. 

That  lb.  instead  v>f  plotting  the  vectors  r, . i  /.  in  reconstruction  space  R”. 

plot  the  vectors  L'y . L'*y,..  One  immediate  positive  consequence  of  this 

change  of  variables  is  the  btatistical  linear  independence  of  the  new 
variables.  The  covariance  matrix  of  the  new  trajectory  matrix 


is  -S''S,  a  diagonal  matrix. 

In  practice,  one  can  do  better  than  5  =  C  T  This  is  because  some  of  the 
nonzero  singular  values  are  dominated  by  noise.  .\  rule  of  thumb  ib  to 
Ignore  (by  setting  to  zeroi  all  singular  values  below  the  noise  floor  of  the 
experimental  data.  Ignoring  all  but  the  largest  A  singular  values  is 
equivalent  to  letting  the  filter  B  in  Eq.  i3.1 1  be  the  top  k  rows  of  The 
rows  of  are  orthogonal,  so  B  is  still  full  rank.  Theorem  3,1  implies  that 
F{B,  /i.  g)  will  typically  be  one-to-one  and  immersive. 

This  program  was  followed  in  ref.  2.  in  the  context  of  measuring  the 
correlation  dimension  of  chaotic  attractors  in  a  stable  way.  They  used  a 
filter  B  that  consisted  of  the  rows  of  that  corresponded  to  singular 
values  above  lO""*. 
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3.3.  Conditions  on  Periodic  Orbits  Which  Imply  One-to-One 

f  or  special  filters  fl,  conclusions  I  and  2  of  Theorem  3.1  can  fail,  but 
only  for  periodic  points.  That  is.  some  periodic  points  of  period  less  than 
>v  may  be  mapped  together  under  the  map  FiB.  Ii.  ai 
For  example,  assume 


and  assume  that  v  has  a  period-4  orbit,  that  is.  v'^l.v)  =  v.  Then  for  any  /». 
FiBJi.}’)  maps  ail  four  points  of  the  period-4  orbit  to  the  same  point  in 
RK  so  F(fl.  h.  V)  fails  to  be  one-to-one.  There  is  no  way  for  any  observation 
lunction  to  distinguish  'he  four  points.  Nince  their  outputs  are  being 
.iveraged  o\er  the  entire  cycle.  Thus,  the  filtered  dclav  coordinate  map  lails. 
lor  ail  observation  functions  h.  to  be  one-to-one. 

A  similar  problem  occurs  with  the  filter 

/i  0  I  0  0\ 

fl  =  [o  1  0  1  0  l3.6i 

\0  0  I  0  1/ 

Now 

F{BJi,  .gl.v^tjl/il.Y)  +  /j(g*(.vn). 

jf/ll.gt.Vl)  +/j(,g'(  Y))). 

\{h{  if*t  V))  hi  viill 

\ssume  that  the  period-four  v'rbit  «'i  e  consbts  vM  =  ei  v„t. 

Y>  =  4'\.  v.,l.  and  .V,  =  c  Yv,,}.  Now  and  \ ;  are  mapped  to  the  same  point 
in  the  reconstruction  space  by  FiB,  h.  el.  and  the  same  goes  for  a,  and 
Vi.  Again,  the  map  cannot  be  one-to-one  tor  any  h. 

A  second  obvious  problem  can  be  illustrated  when  the  dynamical 
system  has  more  than  one  fi.xed  point.  No  matter  how  /» is  chosen,  the  filter 

-3  ^ 

0  -  4  0  |3,7) 

\o  0  ^  -y 

maps  all  fixed  points  to  the  origin  in  RK  violating  the  one-to-one 
condition. 

In  each  of  these  situations,  the  underlying  dvnamical  system  g  may 
dictate  that  some  periodic  points  will  become  iuw..:.ried  under  a  particular 
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filter  '5;  no  matter  how  ’'generic"  the  obserV.atiori  function; /^  Gn  the-^ 
hand,  these  identifications  occur  oiily  at  peripdic.  pdihtl  Further,  even  iii; 
the  case  of  periodic  points,  it  turns  biit  that  the  restrictions  on  ^^exem¬ 
plified  by  thethree  cases 'above^are  the  pn/y  restrictions,  That  is.  if  these  are 
avoided,  then  g)  is  one-to-one  for  a  prevalent  set  of  obsefvatipri 

functions  h. 

To  be  more  precise  about  these  restrictions,  we  need  to  make  some, 
definitions.  For  each  positive  integer  p.  denote  'by  .-t  ,  the  set  of  period-p 
points  of y  lying  on  .I  That  is.  .1^  =  ;.ve.T:  g''{.v)  =  -v!.  Let  /„  denote  the 
identity  matrix  and  ( -.  ■ )  denote  greateri  common  divisor,  We  will  use 
the  convention  that  (/?. 0l  =  0.  For  integers  /ix/^0.  define  the 
p  X  ( p  -(/?,</) )  matrix 


Define  to  be  the  4  x  ( /?  -  ( p.  </)))  matrix  formed  by  repeating  the 
block  vertically,  and  for  a  positive  integer  u.  define  C’);^  to  be  the 
matrix  formed  by  the.  top  w  rews  of 

Theorem  3.3.  Let  C  be  an  open  subset  of,  let  y  be  a.  smooth 
diffeomorphism  on  i\  and  let  .1  be  a  compact  .subset  of  i'  of  box-counting 
dimension  </.  Let  u-  and  it  be  integers  satisfying  >  hi  Assume  that  B 
is  an  n  x  le  matrix  of  rank  /r  which  satisfies: 

A1 .  rank  5C",', 2  >  boxdimi .  for  all  1  <  ^  u-. 

A2.  rank  5C!;„  .•  bo.xdimi.i.jdbr  all  I  -5  p  <  /» ^  a. 

Then  for  almost  every  smooth  function  //.  f{B'.  //.  c)  is  one-io-one  on  .1. 


Remark  3.4.  Note  that  rank  =  p  -  ( p,  </ 1,  and  so  rank  = 
minju’.  p-(p,  </)*,  It  follows  that  rank  BC^^j^minln,  p\  and  rank 
min  j/j.  pi2]  for  5=  /,,,-und  also  for  almost  every  n  x  »■  matrix  B. 

To  illustrate  the  restrictions  that  Theorem  3.3  puts  on  moving  average 
filters,  assume  that  B  is  the  3x6  matrix  (3.5).  In  particular,  the  filter  B 
must  satisfy  condition  A2  for  /?  =  4.  p  =  1 .  which  means 


/  1  0  0\ 
0  10 


\  0 


0  I 
•  I  -1 
0  0 
I  o/ 


>  boxdim  .44 
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Sauer  et  at. 


The  rank  on  the  left-hand  side  is  zero,  however,  and  if  there  exists  any 
^riod-4  orbit,  the  filter  1 3.5)  fails  this  condition.  This  is  consistent  with 
whot  we  have  already  noticed:  in  the  presence  of  a  period^  orbit,  the  map 
FiB:  h..g)  is  lidt  one-to-one  for  any  h.  ~ 

The  filter  i3.6)  satisfies  the  above  conditioh  as  long  as  there  are  finiiesy 
many  period^  orbits.  However,  it  fails  condition  A2  for  p  =  -l.  </  =  2:  ^vhich 
requires 


This  IS  again  cohsisicni  wuh  our  earlier  observation. 

Finally,  if  there  exist  fi.xed  points,  the  filter  i  .'.'i  fails  the  csindiiicn  \  I 
lor  p  ~  1  if  there  exist  ft-Xed  points.  That  is  because  condition  .\  1  requires 


rank  B 


P\ 

w 


>  2  ■  bo.xdim  .1 , 


Since  the  rank  on  the  left  side  is  zero,  the  condition  fails  unless  ihe  ^et  of 
fixed  points  is  empty. 


3.4,  Conditions  on  Periodic  Orbits  Which  ImpjY  an  Irnmersion 

There  are  also  rather  obvious  situations  when  certain  fillers  cause 
F{B.  /i,  .If)  to  faillo  an  ah  immersion.  Assume"thai  g  is  a  diiTeomorphisrh-on 
a  circle  that  has  a  fixed  point  .v.  ,-\ssumc  that  the  derivative  of  e  a,t  .v  is  -2. 
Consider  the  filter 


(3.91 


In  this  case,  the  map  F(B.  /i.g)  cannot  be  an  immersion  at  .v  for  any  obser¬ 
vation  function  h.  For  a  tangent  vector  v  in  T,.Xf=  /?',  the  derivative  map 
is 
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DFi  B.  h.  ;( .V 1  r  =  3 


(  Vhixfv  .  \ 

Dz{xm 

\  VA(  jf  ■  M  .xr  n Dg“  ^ '  i  X )  V/ 


'  «  • 

/  -  « 

5  • 

0  o\ 

=' 

0  i 

^0  0 

i  \l 

Vhix)'{  -Zv\ 
V/j(.Yi'  i4rl 
\V/j(.Yr'(  -•''fl/ 


/0\ 

d 

0/ 

so  the  tangent  map  of  FiB.  h.  z)  at  .v  is  the  zero  map. 

In  the  case  of  an  /n-dimensional  manifold  .U  with  a  fixed  point  .v.  a 
can  he  checked  that  for  a  filter  5  of  this  type.  FiB.  h.  c  i  wiil  faii  to  he  an 
immersion  nr  ail. /j  as  long  as  the  linearization  of  c  .st  '"as-an  eigenvalue 
ot  —  1.  .\s  in  the  one-io-one  case,  ihe  immersion  will  fafi  i-niy  :or  pcriouic 
points. 

To  be  precise,  given  numbers  i , . c,.  define  the  /.  <  rp  matrix 


DJ'Ic, . cM  = 


/  Ir 


<--Ur 


(■  r  ‘r  ■ 

cf/., 

■:/ 


(3.101 


where  /,  denotes  the  px  p  identity  matrix.  For  a  positive  integer  si.  let 

'0",{c, . cj  be  the  matrix  formed  by  the  top  ir  rows  of  D  !  (t , . cj;  If  the 

c,  are  distinct,  then  rank  . c.l  =  min  I  u'.  rp 

Theorem  3.5.  Let  be  an  open  subset  of  R'.  let  v  he  a  ^mouth 
diffcpmprphism  on  L\  and  let  .1  be  a  compact  'ubset  •>!  a  smooth 
m-manifold  in  V.  Let  u-  and  /i  be  integers  satisfyingn-  In.  .Assumc-thai- 
the  linearizations  Dg/’  of  periodic  orbits  of  period  /»  less  than  or  equal  to 
11'  have  distinct  eigenvalues.  .Assume  that  D  is  an  n  x  ir  matrix  of  rank  n 
which  satisfies: 

A3,  rank  . >  boxdimi  -r  r  -  1 )  for  ail  \  ^  p<  n. 

l  ^r^/n.  and  for  all  subsets  . sif  eigenvalues  of  the 

linearization  at  a  point  in  .-I.,. 

Then  for  almost  every  smooth  function  It.  F(B.  Ii.  g)  is  an  immersion  on  .t. 

Remark  3.6.  See  Theorem  4.14  for  a  proof.  Note  that  since  rank 

. =  min!  IV.  r/i  j  distinct  eigenvalues  it  follows  that  rank 

BDp  =  min{/j,  rp]  for  the  original  delay  coordinate  case  of  3  =  /„,  and  also 
for  almost  every  n  x  w  matrix  3. 


;69«. 


To  iliiKtraigi  the  condition  A3  is  not  s:: 
a  fixed  point  with  an  eigenvaiue  of  —1= 
rank  ^D:“(  -21>l).  but 


\[-2)K/ 


Sauerer-a/:- 

:d  for  fil‘’»-  1 3.9)  when  s 
at  condition  requires  that 


4.  PROOFS 

This  section  contains  the  proofs  of  the  results  stated  above.  After 
some  fundamental  lemmas,  we  give  the  proofs  of  the  Whitney  forms  of 
th^  embedding  theorems.  These  follow  ■Len:ima4.11.  The  proofs  oi'  the 
delay-coordinate  forms  involving  filters.  Theorems  3.3  and  .'  5.  :oilow 
immediately  ifom.  Theorems  -.1,3  and  -14.  respectively.  This  'cction 
concludes  with  the  proof  of  Theorems  2."'  and  3.1.  which  are  special:  cases 
of  Theorems  3.3  and  3.5. 

Lemnia4.1,  Let  //  ar^"  k  be  positive  integers.  r.,  distinct 
points  in  /?*.  and, i<,. ....»„  in  R.  f, . r.,.in  /?*. 

1 .  There  exists  a  polynomial  h  in  k  variables  of  degree  at  most  n  -  I 

such  that  for  /  =  I . n,  /i(.r,)  =  if,. 

2.  There  exists  a  polynomial  /)  in  A’  variables  of  degree  at  most  u  such 
that  for  )  =  I...;.  n.  Vhi  y-)  =  r  . 

Proof.  I.  We  may  assume,  by  linear  change  of  coordinates.,  that  the 
lirst  coordinates  of  v, . are  distinct.  Thcri, ordinarv  vme-\ariable  inter¬ 

polation  guarantees  such  a  polynomial. 

2.  First  assume  A  =  I.  There  exists  a  polvnomial  of  degree  at  most 
n-\  in  one  variable  that  interpolates  the  data.  The  antiderivative  is  the 
desired"  pdlyhorhiar/i; 

In  the  general  case,  by  a  linear  change  of  coordinates.  may  assume 

that  lor.  each  j=  I.....  A.  the  /ih  coordinates  of  y^ y„  are  distinct.  The 

above  paragraph  shows  that  for  j=  I A  . there  is  a  polynomial  of  degree 

at  most  n  in  the  yth  coordinate  .v.  whose  derivative  A,.,  interpolates  the  y.th 

coordinate  of  u.  for  i=  I . n.  The  sum  of  all  A  of  these  polynomials  is  a 

polynomial  of  degree  at  most  n  which  satisfies  the  conclusion. 

Lemma  4.2.  Let  Fi.x)=  .Hx-^h  be  a  map  from  R'  to  R”.  where  .V/ 
is  an.n  X  r  matrix  and  R".  For  a  positive  integer  r.  let  "  ‘  O  be  the  rth 
largest  singular  value  oi  .1/.  Denote  by  the  ball  center^..  ..t  the  origin 
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of  radius  in  R‘.  and  bv  Sj  the  ball  centered  ar  rhes  briain  of  radius  o  iii 
Then  '  . . 


WoHB„r.F-'l.B,)) 

V6\iB,f 


<2r^(()/apK 


Proof.  Mote  that  decreasing  aiiy  ;singular  value  of  .V/  does  not 
decrease  the  left-hand  side.  Thus  \ve  tfiay  assume  that  the  singular  values 
of  M  satisfy  a^=  ■■■■  =(t^  =  (t.  and  0  =  a, . =  d>..+ ,  =  •  •  •.  Let, ,V/  =  WSU be 
the  singular  value  decomposition  of  .V/,  Here  5  .is  a  diagonal  matrix  with 
entries  .v,,  =  •••  =i-„  =  /r  and  all  other  entries  zero.  V  is  an  nxn 
orthogonal  matrix,  and  L'  is^a  /  .x7  orthogonal  matrix. 

Since  the  columns  of  C  and  I '  each  form  ah  orthonprmal  set.  \ye 
recognize  .\f  B ,  =  T.S’f  ''5 ,  as  an  r-diniehsional  ball  of  radius  cro  lying  in  R". 
!n  fact,  the  first  r  columns  of  1'  magnified  by  the  factor  ao  arc  radii- which 
span  .\fB,,. 

The  serf  '(fl^)n  B,,  consists  of  the  vectors  in  B^  whose  image  by  M 
lands  in  a  ball  of  radius  o  in  R”.  This  is  a  cylindrical  subset  of  Z?,,. with  base 
dimension  /•  and  bisf radius  O/.o-.  The  subset  thus  has  v-dirriensiohal  volume 
less  than  (6laYC,p‘  ''C,.,,  where  Cr  =  Tt'-‘l{rjl)\  denotes  the  volume  of 
the  r-dimc'nsional.  unit  ball.  The  volume  of  5^,  is  so 

Vol(/?„.vF-'(fl,))  ((Va)V'-T,,.,C„  vi/'AY 

VoKfi,,),  ^  p'C,  [apj 


Lehirha  4.3.  Let  5  be  a  bounded  subset  of  bo.xdimuV)  =  (/..  and 

let  O'o,  O', . 0,  be  Lipschitz  maps  from.  0  to  R".  .\ssume  that  for  each  .v 

in  i';  the  r  th  largest  singular  value  of  the  irx  r  matri.v 

.Vrv=  IGi(.v) . 0,(.v)i. 

is  at  least  n>0.  For  each  xeR'  define  0,  =  OotX,'=i 

almost  every  x  in  R\  the  set,  Of '(0)  has  lower  box-counting  dimension  at 

most  (l-r.  If  /•>(/,  then  Of '(0)  is  empty  for  almost  every  x 

Proof.  For  a  positive  number  p.  define  the  set  5,  to  be  the  ball  of 
radius  p  centered  at  the  origin  in  R'.  For  the  purposes  of  proving  the 
theorem;  we  may  replace  R'  by  B^.  For  the  remainder  of  the  proof,  we  will 
say  that  0,  has  some  property  with  probability  p  to  mean  that  the 
Lebesgue  measure  of  the  set  of  a  e  B^  for  which  0,  has  the  property  is  p 
times  the  measure  of  B^.  For  e.xample,  if  xsS,  then  Lemma  4.2  shows 


that  |G,(a')!,— iGo(.v-;jrt- .-V/.^Cajj  ^e:  for  as .6.,  with  probabilitv  at  most 
l"He/dpY. 

Let  Z)->-  ci:  and-iet  En  >  0  be  such  that  for  0  <  c  <  Eo,,  the  followingitwo 
tacts  hold;  First,  5  can  be  covered  by  /:  ^  L'-dimehsibnal:  bails  5{.y.  e)  of 
radius  e,  centered  at  xe  S.  Second.,  by  the,  Lipsehitz.  condition  there  exists 
a  constant such  that  the  image  under  any  G^..  xe.B,..,  of  ahy  E-ball •iri  /?''' 
intersecting  5  is  contained' in  a  CE-ball.  in  R".  For  the  remainder  of  the 
proof,  we  assume  c  <  e„. 

The  probability  that  the  set  ,G,('B(.y.  e))  cdmairis  0  is  at  most  the 
probability  that  ;Gj(.v)l  <  C’c.  which  is  a  constant  times  c\  since  p  and  <7 
are  fixed.  For  any  .positive- number  M,  the  probability  that  at  least  .U  of 
the  e''’’  images  G,(5(,t.  e))  contain  0  is  at  most  Ci  E'’  “'^'.V/,  Therefore. 
G  ~  '(0).  can  be  covered  by  fewer  than  .VT=  f:  of  the  E-balls  except  with 
probability  at  most  C^c'  long  as  />  >  D  -  >■.  this  probability  can 

be  made  as  small  as  desired  by  decrcasimi  e. 

Let  p  >  ().  There  IS  a  sequence  ,  approaching  U  such-that  (/  '0i 

canbe  covcred  by  lewer  thah.E  "  balls-exceptEfor  probability  at  most,  pZ 
Thus,  the  lower  box-counting  dimension  of  G,''(0)  is  at  most  h.  o.xcept 
for  a  probability  p  subset  of  x.  Since  />>0  was  arbitrary,  lower 
boxdin.(G,~ 'tO.)T<;  6  for  almost  ^'’ery  a.  Finally,  since  this  holds  for  all 
lower  bbxdimlGf'fO))^ (/-/-.  | 

Remark  4,4.  In  case  boxdimiSLdoes  not  exist;  the  hypotheses  of 
the  lemma  can  be  slightly  weakened  by  .allowing  (/  to-be  the  lower  ho.x- 
counting  dimension  of  S.  A  slight  adaptation  of  the  proof  shows  that 
boxdim  can  be  replaced  throughout  Lenfima  4.3  by  Hdusdorff  dimension. 
In  particular,  if  r  >  HplSL  then  Gf'lO)  is  empty  for  almost  every  x  in  R\ 

If  in  Lemtha  4.3  we  assume  that  rank(.\f.)  ;:</  for  each  ;ve..S  instead; 
ol  the  assumption  on  the  singular  values,  then  i/,  '(Ol.is  empty  for  almost 
every  x.  That  is  because  one  can  apply  Lemma  4-3  to  the  set  OL  =  kgS: 
rth  largest  .singular  value,  of  .U.xt]  to  get  Gf'tOlo .s,  =  O.  then 
•5  =  U<7>.> -S'.,  implies  Gf '(01  =  0.  We  state  this  fact  m  the  next  lemma. 

Lemma  4.5.  Let  S  be  a  bounded  subset  of  R''’.  boxdimi5)  =  </,  and 

let  Go,  G, . G,  be  Lipsehitz  maps  from  S  to  R".  .\ssume  that  for  each  ,v 

in  S,  the  rank  of  the  n  x  i  matrix 

.V/.=  !C?,(.v) . G,(.vi: 

is  at  least  r.  For  each  xe  R'  define  G^  =  Go-r3I[=i  ‘-^,0,.  Then  for  almost 
every  a  in  /?'.  the  set  GT'(O)  is  the  nested  countable  union  of  sets  of  lower 
box-counting  dimension  at  most  d-r.  If  r>d,  then  G^'lO)  is  einpty  for 
almost  every  a. 
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Lemma  4.6.  Let  be  a  compact  subset  of 'T?*.  Let  E,  be 

Lipschitz  maps  from,  , to  7?".  For  each,  integer  r  ^  O.  let  Srbe  the  set  of’ 
pairs  A-  #  V  in,  .-t  for  which’ the  tvx.i  matrix 

!  F,(.v )  - Fit.n.....  F7.V)--  F',{y)\ 

has  rank  r.  and  let  J,  =  lower  boxdimi5>).  Define  /^;.= /^o t ZI- 1 
A  -rfR".  Then  for  x=  u,.. ...a,,.):  outside  a  measure  zero  subset  of  R'.  the 
following  hold: 

1.  If  r/,  <  r  for  all  integers  then  the  map  f,  is  one-to-one. 

2,  If  d,  ^  r  for  some  integer  r  $i  0.  then  for  every  o  >  0.  the  lower  bo.v 
counting. dimension  of  the  ci-distant  self-intersection  set  r(f,.  Jl  is 
at  most  </.  T  r. 

Proof,  For  /  =i)....; define  (j  i.\.  ;  i  =  /•'  i.vi  -  F  i  ;  i.  ()n  the  .set.  S.. 
the  rank  of  the  n  x  i  matrix 

=  ;G,(.v.  r) . G,(.v.  r)l* 

I 

is  r. 

If /•?>«/,,  Lemma 4.5  shows  that  for  almost  every  xeR'.  the  origin  is 
not  in  the  image  of  S,  under  the  map  G,  =  Got3I  '•‘■G',.  or  equivalently. 
^,{-v)  7*  r,(.i’)4or  .V  f  in  5,.  If  r  >  </,  for  all  i\  then  E,  is  one-to-one.  since 
each  pair  .vse  y  lies  in  some  .S,. 

If  r  c.  t/,,  let  ( .1  X  ,-1  =  ;  (.V.  r  1  e  .d  x  .-1:  :.v  -  rl  ^  i)  J  be  ‘the  .subset  of 

d-distant  pairs  of  points  in  .-1  x  . i.  Since  (.d  x  .4),,  is  compact  for  any  i)>0. 
the  minimum  of  the  »ih  singular  value  of  ,\t in  l.-l  <  .1 1,  b  greater  than 
0.  Lemma  4.5  shows  that  for  almost  every  x,  the  origin  i.s  in  (/.K.l  ■<  11.) 
lor  a  subset  of  (.1  x  ,-t with  lower  box-counting  dimension  at  most  (/,  ~r. 
Therefore  the  d-distani  self-intersection  subset  ElE^.oi  of  .1.  which  is  the 
image  of  this  sub.set  under  the  projection  of  (.1  x  .-I ),  to  .1.  has  dimension 
at  most  —r.  | 

Theorem  4.7.  Let  1  be  a  compact  subset  of  lower 
boxdimt.-l )  =  d.  If  /i  >  2d.  then  almost  every  linear  transformation  of  /?*  to 
R"  is  one-to-one  on  .1. 

Proof,  This  follows  immediately  from  Lemma  4  6  and  the  remark 
following  it.  Let  [E,]  be  a  basis  for  the  /i/:-dimensional  space  of  linear 
transformations.  For  each  pair  .v  5^  y,  the  vector  .v  -  y  can  be  moved  to  any 
direction  in  R"  by  a  linear  transformation.  In  the  terminology  of 
Lemma 5„  =  ^x-/4— J  and  S,  is  empty  for  r^n.  Since  lower 
boxdimiS^)  =  2d<  n.  almost  every  F,  =  21  x,F,  is  one-to-one  on  .4.  | 


Remark  4;8’.  It  is  .interesting^  that  :ho  statement  sirhiiar  to 
Theorem.4.t  can  be  made  if  bgx-iCpUriting'  dimehsign;  is  replaced';  .by 
Hausdorff-dimensigii;  In  an  Appendix  to  this  .work  provided-  by  51.  Kaii, 
examples  are  constructed  of  compact  siibsds  J^df  any  .Euclid, ean  space 
that  have  Hausdbrff  dimension  il  ~  0;,  and  such  that-nO  .projection  to  R"  for 
«<^;  is.orie-to-one  oh 

This  striking  difference  between,  ‘box-couhtihg;  diihension  and 
Hausdorff  dimensigh  is  related  to  the  fact  that  Hausdprff  dimension  dpef 
hot,  work  well  with  products.  Extra  hypotheses  are  needed  oh  ih  :pa,rr 
ticular.  on  the.  Hausdorff  dimension  of  the  product  .-Ix^.  .to  prove  an’ 
analogue  to  Theorem  4.7.  For  exaniple.  Mane  has  shown  (see  ref.  17  and  its 
correction  in  ref.  9.  p.-627Vlhai  if  /i  >  HD(,-1  x  .4)+ 1.  theii  the  conclusion, 
of  Theorem  4.7  again  holds.  Of  course,  using  Lemma  4;3  and  Remark  44; 
•it  turns  out  that  only  n.>  HDI.4  x  .4)  is  required: 

Theorem  4.9.  Let  .4  be;  a  compact  subset  of  R\  .md  let, 
/I  >  HD(,4'.<  .1 1.  Then  almost  every  linear  transformation  of  /?'  to  R" 
one-to-one  on  .4. 

It  was  shown  in  ref.  10  that  under  the  hypoihcsc  of  theorem  4.7; 
almost  every  orthogonal  pxojacilon  is  one-to-one  (and  in  fact  Itasca  Holder 
continuous  inverse). 

Definition  4.10.  For  a  compact'  differentiable  manifold  )/.  lot 
(.wr):  .YS.U,  be  the  nmgL'hi  Inmdic  of  M.  and  lot 

i’(4/).=  \  (x,  lie  T{M)\  !rl  =  1 J  denote  the  mi/r  tangent  hunalc  of  M. 

Lemma  4.11.  Let  .4  be  a  compact  subset  of  a  smooth  manifold 

embedded  in  /?*'.  Lot  r,„  F, . F,-.  F*  —  R"  be  a  set  of  smooth,  maps  from 

an  open  neighborhood  .C  of .  1  to  R":  Fi  each  positive  integer  r.  lot  S,  be 
the  subset  of  the  unit  tangent  bundle  .Vi.l )  .such  that  the  n  x  t  matrix 

{DF,(-v)(i‘),..;.  DF.ixHe)] 

has  rank  and  let  </,  =.lower  boxdimfS,).  Define  F^  =  Fn-r  ^ ,  :(,F,: 
U  -*  R".  Then  the  following  hold: 

1.  If  </,  <  r  for  all  integers  r  ^  0.  then  for  almost  every  x  s  R'.  the  niap 
F,  is  an  immersion  on  .1. 

2.  If  for  some  r^O.  then  for  almost  every  y.eR'.  F,  is  an 

immersion  outside  a  subset  of  .4  of  lower  boxdim  ^t/,-  r. 

Proof.  For  /  =  0,..., /,  define  G,:  S(.4  )-♦/?"  by  G,{.v.  i')=  DF,{.y)i'.  If 
r>ci,  for  all  r^O,  then  Lemma  4.5  applies  to  show  that  for  almost  every 
a,  G"'(0)n54s  the  empty  set.  Since  S(/4)  is  the  union  of  all  5,,  G~'(0) 
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is  empty;  Tfhus.  no  unit,  tangent  vectdf  is  mapped  to:  the  origin;,  and  is, 
an'immersidh. 

In  case  ^/i  ^  r  for  some  r.  there  -ii  a  ^positive  lo.wer  bound  .on  the 
singular  vah-ies  ot the  Q,  oh  S’MlpLemma  ^i  implies  that  thereis  a -subset  ; 
of  unit  tangent  vectors^of  lower  ;boxdim  4  that  can  map  to  zero..  The 
projection  of  this  subset  into  ,*1  has  .ipvyer  ‘boxdim<  </,  -  r.  | 

Proof  of  Theorems  2.2,  2. 3.  arid  Z  7  6.  Theorem  2.2  is  a  special  case 
of  Theorem  2.3;  To- prove  the  latter,  we  need  to  show  that  a  prevalent  set 
of-maps  are,  one-to-one  and  immersive. 

Let  be  .a  basis  for  the  set  of  linear  transformations  from 

7?*  Z?";  In.  the  notation*  of  Lemma  4.6.  the  set  5„  =  .-1  x  .-1  -  .1.  and  S,  =  0 

for  r  #  n.  Sincc  -boxdimi  .-1  x  ^1 )  =  2il  <  n.  f ,  is  one-to-one  on  .-1  for  almost 

every  -xeR'.  If  any  other  maps  F.. . F,  are.  added,  ihe  rank  oi  .\f., 

cannot  drop  for  any  pair  .v  ^  y,  so  almost  every,  linear  combination  oi 
F|(....  F.  is  one-iorone  on  .-1. 

The  proof  of  the  immersion  half  uses  Lemma  4. 11  instead  ol 
Lemma  4.6.  Since  boxdiml-i)  =  (/,  C  is  a  subset  of  a  smooth  manifold  ol 
dimension  at  ihost  </, 'and  therefore  boxdim  5(C}  ^  2r/-  I.  In  the  .potai  on  , 
of  Lemma  4.11.  S„  =  SfC)  and  S,  =  0  for  Since  /o  2(/>  2t/- 1=' 
boxdim  5,,,  the  proof  follows  from  Lemma  4.1 1. 

The  proof  of  Theorem  2.10  is  similar,  except  that  the  second  part  ol 
the  conclusions  of  Lemmas  4.6  and  4.11  are  used.  For  e.xample.  in  the  use 
of  Lemma  4.6.  S„  =  .4  x  .4  -  J  and  5,  =  0  for  r  yt  n  as  before,  but  now 
boxdimt.4  X  .4)  =  2</^/i.  Thus  for  each  (5>0.  for  almost  every  F,,  the 
ti-distant  self-intersection  set  r(F,,  i))  has  lower  box-counting  dimension  at 
most  2J-M.  The  immersion  half  is  again  analogous.  | 

Definition  4.12.  Let  C  be  an  open  subset  of  let  .g:  6‘—  L'  be 
a  map.  and  lei  h:  /?  be  a  function.  Let  w  or'  be  integers  and  set 

H‘=  u' —  u' ■  4- 1.  For  1  ^  ^  u\  set  y,  — s"  so  that  =  and 
.?»•  =  •  Let  B  be  an  n  x  u-  matrix.  Define  the  filtered  delay-coordinate  map 

by 

FZ'.[B.  h.  ^H.x)  =  5(/i(gi(.Y)).  liigzix)) . 

=  5(/i(^"'(.v)) . //(^"■(.x)))'' 

Theorems  2.7,  3.1,  3.3,  and  3.5  are  corollaries  of  the  next  two  results, 
for  which  we  will  use  the  following  notation.  Let  g  denote  a  smooth 
diffeomorphism  on  an  open  neighborhood  U  in  /?*.  Let  lii,...,h,  be  a  basis 
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lor  the;  polyhqmiais  in  k  '-ariables  of  .degree  at  most  .2u^  -For,  ,a  srhooiH 
function  /i,) -on  and.  fdr  d^fme  //,:=«orr2'i,. jFbr.  each: 

positive -integer  pi  denote  by:  ne  set;of  period-p,  .pdiiits^df  g  lying  dii;  .4. 
JThat  ii  ..4^  =  [  X  e.A ;  .v  1  =  A- 1  ...Let  the'inatrices  CJ^'  be  as-in  theorem  3.3. 

1  heorem  4.T3.  Let  g’  he  a  smooth  diftedfiiorphism'  on  an.  open 
neighborhood  C  of  /?*'.  aiid.let-.-i  be  a. compact  subset  of  I',  boxdiitii  .4:1  =  </. 
Let  n  and  \r  '  <;u'"  be  integers.  =  t-u'~  -  1.  .Assunrie  that  the 

n  u'  -matrix  fl  saiisfies: 

Ai .  rank  ‘5C^  >  2  •  boxdjmi  .4  ^ )  for  aif  i  ^  p  <  a-. 

A2.  rank  BCj;^  >  boxdinil  .4^;)  for  all  1  ^  c/  <  p  ^  u'. 

Let  /j,  be  a  basis  for  the  polynomials  in  k  variables  of  degree,  at  most. 
2u'.  then  for  any  smooth  function  -P,,  on  R‘^.  and  for  almost  every  x  =  R\ 
the  fdilowiny  '.old; 

1.  If  /!  >  2(/.  then  Fi  B,  h,,  L'  —  R“  is  one-to-one  on  .1 

2.  If  iiiiZJ,  then  for  every  »)>0,  the  (i-distant  self-inierseciioh  set 

i'),  (5)  has  lower  box-oouhtinu  dimension  at  most 

24- M. 

Proof.  For  /  =  I . /  define 

F,(.v)  =  fi  : 

By  definition.  F{fl, /j,,  Pr  tisc  Lemma  4.6.  we  need  to  cheek 

for  each  .v  ^  y  the  rank  of  the  matrix 

M , ,  =  I  f ,  I  .V I  -  r,  (  r  I . F.ix  1  -  /•'.(  y  \  I 

which  can  be  written  as 


B 


»(■'<))  •••  li,{y»{xn-li,{}'Jy))j 


=  BJH 


where 


H  = 


q  ^  2iv.  the  z,  are  distinct,  and  4  =  is  a  u-  x  p  matrix  each  of  whose  rows 
consists  of  zeros  except  for  one  1  and  one  - 1.  By  part  1  of  Lemma  4.1.  the 
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rank  of  //  \s  q.  We  diyide  the  study  of  the  rank  of;  into  three 

easel 

Case  U  .V  and' y  are  not, both  periodic  with; period 

In;this  case.  j„.  is  upper  or  lower  triangular,  and. fank(/v>*)  =  ‘^'-  Since 
B,.J.  and  H  are  onto  linear  transformations,  the  product  BJH  is  onto  and 
has  rank  n.  The  set  of  pairs  of  case  1  has  box-counting  dimension  at 
most  2d,  and  rank(M„,)  =  rt.  If^  has  no  periodic  points  of  period  we 
are  done,  and  conclusion  I  (respectively.  2)  of  Lemma 4';6  implies  conclu¬ 
sion  I  (resp.,  2)  of  the  theorem.. 

The  remaining  two  casw  are  necessary  to  deal  with  periodic  points  of 
period  ^  »*.  We  show  that  conclusion  I  of  Lemma  4.6  applies4n  both  cases. 

Case  2:  x  and  y  lie  in  distinct  periodic  orbits  of  period  c; 

.Assume  p  and  q  are  minimal  such  that  =  v..  i'Myi  =  .  and  that 
I  ^  (/  ^  /;  ^5  If.  In  this  case  the  matrix  7,,  contains  a  copy  of  6%,.  Since  H 
is  onto,  rank  .\f,.t-  =  rank  57^,,//  =  rank  57,,.  By  hypothesis,  rank  57„  ^ 
rank  5C);u>  2-boxdim  .-Ip,  which  is  the  box-counting  dimension  of  the  sot 
of  pairs  treated  in  case  2.  By  Lemma  4.6.  for  almost  every  -xeR', 
r ,(.v)#  F,(,r)  fot  every  such  pair  xi^  y. 

Case  3:  Both  .v  and  y  lie  in  the  same  periodic  orbit  of  period  ^u’. 

Assume  /)  and  </  are  minimal  such  that  =  v.  .i''((,vl  =  y.  aiid  that 
\  ^q<p^  \{\  Since  .v  and  y  lie.  in  the  same  periodic  orbit,  the  column 
space  of  7,.,.  contains  the  column  space  of  C);„.  Thus,  rank  57,,//  = 
rank  57,,  2:  rank  5C”;,>  boxdim  .-I,,,  which  is  the  dimension  of  the  pairs 
X  9^  y  of  case  3.  Now  Lemma  4.6  applic.s  to  give  the  conclusion.  | 

Theorem  4.14.  Let  y  be  a  .smooth  diffcomorphism  on  an  open 
neighborhood  C  in  R".  and  let  .1  be  a  compact  subset  of  a  smooth 
w-manifold  in  C.  .Assume  that  the  linearizations  of  periodic  orbits  of  period 
less  than  if  have  distinct  eigenvalues.  Let  n  ^  if  be  positive  integers  as  in 
Theorem  4.1,3.  and  assume  that  the  n  x  if  matrix  5  satisfies: 

A3,  rank  5Z)),'(a„.....a,J > boxdimi.-lp -r /•- 1)  for  all  \^p<\v.  . 

and  for  all  subsets  . A,,  of  eigenvalues  of  the 

linearization  Dg^  at  a  point  in  Ap. 

Let  h. . Ii,  be  a  basis  for  the  polynomials  in  k  variables  of  degree  at  most 

2if.  Then  for  any  smooth  function  /i,)  on  and  for  almost  every  -x  e  R'. 
the  .following  hold; 

1.  If «  ^  2m.  then  F(B,  g):  U-^  R"  is  an  immersion  on  A, 

2.  If  rt  <  2m,  then  F{B,  /i,,  g)  is  an  immersion  outside  an  e.xceptional 
subset  of  A  of  dimension  at  most  2m-/i  -  1. 
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Proof,  To  apply  Lemma4.1 1,  we  need  to  check  the  rank  of  the  'j  x  r 
matrix  ’ 


{DF,  ( .V )( L* ) . DF.ix  lit')),  (4.1) 

fpr  each  (am-)  in  the  unit  tangent  bundle  For.  a  given  observation 
Tiihctiori  h.  the  derivative  of  Hfi, /i.  .g )  is 


DFiB,  li.  =  B 


V/j(.g''  {x))^Dg"  (a- If 

'(a’D^D?"  '(A')t' 


If  A  is  not  a  periodic  point  of  period  less  than  w.  then  .g*'  ’(a) . a'  '  *(  vi  are 

distinct  ppints.  The  facts  that  g  is  a  diffeomorphism  and  vr^O  imn'*'  that 
Og'(-vii‘T=0  for  all  /;  Therefore  by  Lemma  4.1.  part  2.  the  sot  of  \ociors 
‘  DFffi. /i,.  A'llAit"  spans  R'\  In  the  notation  of  Lommu4ii.  the 

subset  i'„  contains  all  ..points  of'Sf.Ti  that  are  not  periodic  with  period  less 
than.'ir,  and  </.,  =  lower  boxdim(.I>„)  ^  2m  -  1.  If.?  has  no  periodic  points  of 
period  less  than  >r.  the  proof  is  finished,  by  Lemma  4.1 1, 

If  A  is  a  periodic  point  o*"  period  p  <  u*.  then 


DF{Bs  //.  .?){a)i‘  =  B 


\ 


HUv,  \ 


where 


•V.=  .?"‘^'(A)=  V,., 

//,  =  V/l(A,| 

u-;  =  Dg{ X,  , )  •  •  •  Dg(x , )  Dg"  ( A 1 1- 
Di=Dg(x,  , )  •  •  •  Dg  I A , )  Dg{  X,. )  ■  •  •  Dg(  A,  j 

Each  matrix  D,  has  the  same  set  of  eigenvalues  ai . and  by 

hypothesis,  they  are  distinct.  If is  a  spanning  set  of  eigenvectors  for 
Di,  then  it  checks  that  n;,=  Og(A,_i)-*-Dg(A,)M/  for  l^y^m 

defines  a  spanning  set  of  eigenvectors  for  D,.  Thus,  if 
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iV(  =  is  the  eigenvector  expansion  of  w\i  then  the  eigenvector 

expansion  of  w-,  is  Zr^i  which  has  the  same  coefficients. 

Thus  DF[BJu  can  be  written  as  5  times  the  >v-vector 


To  find  the  rank  of  the  matrix  (4.1)  for  (.v,  v)  where  .v  is  periodic,  we 
need  to  find  the  span  of  B  times  the  vectors  (4.2)  for  h  =  /»,  =  £  ^  s  R\ 

Assume  that  the  eigenvector  expansion  of  i*  has  exactly  r  nonzero 
coefficients  By  Lemma  4.1,  part  2.  the  set  of  vectors  [V/i,(.v,): 

ae  /?'!  spans  /?*.  Then  because  the  u,j,  1  ^j^nu  are  linearly  independent, 
the  vectors  of  form  (4,2)  span  a  space  of  dimension  min{»‘. /'pl  as  a 
spans  RL 

Therefore,  for  this  i  v.  r).  the  span  of  the  vectors  i4.l  1  has  dimension 

equal  to  the  rank  of  /?D“(/. . *,.,1.  By  hypothesis,  the  hoxdim  ol  such 

pairs  (.V.  f)  in  5(;*l)  is  boxdiml.l;,) +  r-  1.  By  hypothesis,  the  rank  of  the 
nxi  matrix  I4.l)  is  strictly  larger,  so  that  Lemma 4.11  applies  to  give  the 
conclusion. 

Proof  of  Theorem  2J.  Apply  Theorems  3.3  and  3.5  with  = 
According  to  Remarks  3.4  and  16.  the  conditions  AI-.A3  translate  to 
p>2  -boxdiml.-lp),  p/2>boxdim(.-lp),  and  min{/i.  rp]  >bo.\diml.-l^)-f  r- 1. 
respectively,  for  I  and  1  ^r^m.  Thus,  the  hypothesis  bo.xdimt .-!,,)< 

p/2  guarantees  that  A 1 -.A 3  hold. 

Proof  of  Theorem  3. 7,  Since  Ap  is  empty  for  I  ^  p  ^  «•.  the  condi¬ 
tions  A I -A3  of  Theorems  3.3  and  3.5  are  satisfied  vacuously. 
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APPENDIX.  HAUS30RFF  DIMENSION-ZERO  SETS  WITH 
NO  ONE-TO-ONE  PROJECfiONS 


Ittai  Kan’ 

The  purpose  of  this  Appendix  is  to  construct  a  Cantor  set  C  =  R"' 
whose  Hausdorff  dimension  is  zero  and  which  has  the  property  that  every 
projection  of  rank  less  than  m  is  not  one-to-one  when  restricted  to  C 

Definition  A.1 .  The  Hausuortj  x-Jmiensional  outer  measure  a  set 
K  is 


=  inf  i'.V 

MU  It.i  •  Tl 

where  the  imlmum  is  taken  over  ail  covers  C  !  -'f  K  with  i!ie  diameters 
of  the  C.  uniformly  less  than  o.  The  Hausaurti  dtmension  of  a  nonempty  sot 
K  is  the  unique  value  of  .v  such  that 

/,  if  r<.v  and  /f‘'{K)  =  0  if  '  \ 

Example  A. 2.  We  construct  the  subset  C  of  /?"'  as  the  union  of  two 
sets  A  =  ij'"„ ,  .-I,  and  B  =  ,  B„  each  of  Hausdorff  dimension  zero,  with 

the  property  that  for  any  projection  P  of  rank  less  than  m  ihc,imagcs  under 
P  of  .-I  and  B  intersect,  and  thus  P  is  not  injective  when  restricted  to  C'. 

The  set  ,l„  lies  on  a  face  of  the  unit  m-cube  and  =  . o.„)  is 

in  .■(,  if  it  satisfies  the  following  restrictions  on  the  binary  expansion 
=  ...  of  its  coordinates: 

1.  If  /  =  tl.  then  a  =0. 

2.  If  i  T=n  and  then  either  la  I  u.  =  0  for  all  /s  l.\/2^.  . .];  or 

(b)  a\~  1  for  all 

Here  the  sequence  0  =  .1/,)  <  .l/|  <  .V/; ...  increases  sufficcnily  rapidly  ^o 
that  limi.f/, . .V/,)  =  r..  If  i^n.  then  the  orthogonal  projection  of  .1,,  on 
the  fth  coordinate  axis  is  a  Cantor  set  which  can  be  covered  by  2"  intervals 
of  length  where  Thus.  .!„  can  be 

covered  by  2'"'~  cubes  with  edges  of  length  2  '  Since  i\  .  we 
see  that  lim^  _  ,  (m  -  1  )r^,.\(it, ..  i  =  0  and  both  the  lower  box-counting  and 
Hausdorff  dimensions  of  .-f,,  are  zero.  Since  .-I  is  the  union  of  m  copies  of 
A„,  we  see  that  both  the  lower  box-counting  and  Hausdorff  dimensions  of 
A  are  zero. 
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The  set  5.,  lies  on -a  face  of  the  unit  m-cube.  opposite  ,=1;,  and./?  is,  in 
B„,  if  it  satisfies  the  following  restrictions  oh  the  binary  expansion  of  its 
coordinates:' 

1.  If  K= /j,  then  h;  =  I .  ; 

2.  (f and;A;>0,  then  either  ta)  =  0  forall  /sI.VAa,.  i, 

or  (b)  /)]==,•!  for  all  i. 

Here  ;  ,l/,I  is  as  above.  The  lower  box-counting  and'Hausdorff  dimensions 
of  B  are  zero.  The  Hausdorff  dirhension  of  C  =  A\j  BAs  zero. 

Let  P  denote  a  projection  of  rank  less  than  m.  Let  t;  =  U’,.  ts . .l\„)  in 

the  null- space  of  P  be  chosen  so  that  :f,i  ^  1  for  all  /  and  for  some 
.particular  We  now  show  that  PTestricted  to  C  is  not  injective  bvTinding 
some  and  ugA.,  such  that  v~h~a.  Using  the  binary  expansion- 
coordinate  notation,  wa  define  a  and  h  as  follows: 

1.  If /  =  /!,  then  Uj  =  0  and  h|=  I, 

2:  If  and  k>0,  then  (a)  ti|  =  0  and  />;  =  (■'  for  all 

and_'b)  =  (cj-h  1)  mod  2  arid  A(=l  for  all 

Clearly  we  have,  i- =  h  -  a  and  by  the  definition,  of  .1,,  and  D„  we  also  have 
U6 .-I,,  and  As fl„.  | 
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Abstract.  In  dynamical  systems  examples  are  common  iii  which  two  or  more  attractors 
coexist,  and  iii  such  cases  the  basin  boundary  is  non-empty. -Thr  iasiri  boundary  is  cither 
smooth  or  fractal  (that  is.  it  has  a  Cantor-like  structure).  When  there  are  horseshoes  in 
the  basin  boundary,  the  basin  boundary  is  fractal.  A  relatively  small  subset  of  a  fractal 
basin  boundary  is  said  to  be  'accessible’  from  a  basin..  However,  these  accessible  points 
play  an  irnpbrtant  role  in  the  dynamics  and,  especially,  in  showing  how  the  dynamics 
change  as  parameters  are  varied.  The  purpose  of  this  paper  is  to  present  a  numerical 
procedure  that  enables  us  to  produce  trajectories  lying  in  this  accessible  set  on  the  basin 
boundary,  and  we  prove  that  this  procedure  is  valid  in  certain  hyperbolic  systems. 

AMS  classification  scheme  numbers;  58F12,  S8FI3, 65Q0S 


1.  Introduction 

Dynamical  systems  often  have  quite  different  behaviour  in  different  open  sets,  each 
open  set  having,  its  own  attractor.  These  open  sets  may  be  the  basins  of  attractors. 
We  are  interested  in  the  boundary  on  the  common  boundary  between  such  open 
sets.  The  common  behaviour  may  be  either  smooth  or  fractal.  A  point  p  oh  the 
boundary  of  an  open  set  U  is  accessible ixom  U  if  there  is  a  curve  lying  in  i/U  {p] 
which  ends  on  p.  The  basin  boundary  is  the  set  of  all  points  on  the  boundary  of  a 
basin  of  attraction  such  that  each  open  neighbourhood  of  p  intersects  at  least  two 
different  basins  of  attraction  [GOYl].  If  the  basin  boundary  is  smooth,  then  each 
point  on  the  basin  boundary  is  accessible  from  two  basins.  In  particular,  if  the  basin 
boundary  is  a  curve,  then  all  of  its  points  are  accessible.  When  the  basin  boundary  is 

*  Research  in  part  supported  by.  AFOSR,  and  by  DARPA  under  the  .Applied  &  Computational 
Mathematics  Program. 
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fractal,  ohIy:a  rejatiyely'Small  subset  of  the:  basin  boundary  consists  of  accessible 
points,  and  generally  no  points  that  are  accessible  from  a. basin  will  be  accessible 
ff;  )ther  basin;  A  cbllection- of  papers  have  .assumed>that  investigators  can 
prov. ..  accessible  trajectpries  on  basin  boundaries  [AS],  [AY],.[GOYij,  [HJ],  but 
no  rigorous  procedures  have  been  presented;  For  more  details,  see  the  discusrion  in 
section  6. 

Studying  dynamical  systems,  one  often  observes  transient  chaotic  behaviour, 
apparently  due  to  the  presence  of  horseshoes.  It  is  well  known  [MGOY]  that 
transient  chaos  is. present  whenever  there  is  a  fractal  basin  boundary  separating  the 
basins  of  two  or  niore  attractors.  For  example,  for  suitably  chosen  parameter  values, 
the- Henoh  map  has  attracting  periodic  orbits  with,  period  3  arid  S,  and  also  a 
non-attracting  chaotic  invariant  set  in  the  basin  boundary,  and  one  observes  that  the 
duration  of  the  transient  chaptic  behaviour.  of  many  trajectories  is  rather  short  before 
they,  settle  dowp  *0  one  of  these  two  periodic  attractors;  Other  famous  examples 
with  chaotic  transients,  due  to  a  bounded  noii-attracting  invariant  chaotic  set  in  the 
basin  bounda^yj  are, the  forced  damped  pendulum  and  the  forced  Duffing  equation. 
Transient  chaos  is  also  present  if  there  is  a  chaotic  invariant  set  in  the  interior  of  the 
closure  of  the  basin.  In  this  case,  the  basin  boundary  can  be  either  fractal  or 
smooih  [KG],  [NYl],  [Ni2]. 

Let  M  be  a  smooth  d-'dimensional  manifold  without  boundary  with  d^2,  and  let 
F  be  a  C^-diffeomorphism  from-Af  to  itself.  :For  a:,  y  in  Af  we  denote  by  p{x,  y)  the 
distance  between  Jt  and  y.  A  set  S  (zM  is  posUively  invariant  if  -F(.S)c’5,  and  is 
invariant  if  F(5)=5.  For  jceAf  and  a  closed  set  5c  M,  we  write  p{x,  S)  = 
min{p(A:.  ye 5}.  An  attractor  A  is  an  invariant. compact  set  in  M  such  that>(l) 
there  exists  an  open  neighbourhood  f/  of  A  such  that' for  each  x  e  t/ the  distance 
p(f"{x),  A)->0  when  and  (2)  there  is  a  point  x  e  A  such  that  the  closure  of 

the  trajecto^  (F"(a:)}„s.o  equals  A.  A  generalized -attractor  is.  the  union  of  finitely 
many  attractors.  We  say  a  region  is  an  open  and  bounded  set  in  M’,  a  transient  region 
is  a  region  that  contains  no  attractor.  For  an  attractor  (or.  a  generalized  attractor)  A 
we  say,  the  domain  of  attraction  of  A  is  the  set  of  all  points  .r  in  Af  for  which 
p{F"{x),  A)-*0  as  n-*<x>.  The  basin  boundary  is  the  set  of  all  points  x  eAf  for 
which  each  open  neighbourhood  has  a  non-empty  intersection  with  at  least  two 
different  domains  of  attraction,  see  [GGYlj.  In  the  literature,  for  an  attractor  A  the 
notions  ‘domain  of  attraction  of  A’  and  ‘basin  of  A’  are  often  equivalent.  On  the 
other  hand,  in  other  studies  of  dynamjeal  systems,  the  notion  ‘basin  of  A’  is  defined 
as  the  region  in  M  that  is  the  interior  of  the  closure  of  the  domain  of  attraction  of  A. 
Therefore,  for  an  attractor  (or  generalized  attractor)  A  we  define ,ha5in (A)  to  be  the 
interior  of  the  closure  of  the  domain  of  attraction  of  A.  We  would  like  to  emphasize 
that  .barin{A}.  is  associated  with  attractor  A  and  may  include  Cantor  sets  of  curves 
that  are  not  in  the  domain  of.attraction  of  A;  that  is,  the  trajectories  of  all  the  points 
on  these  curves  will  not  converge  to  the  attractor  A.  In  the  forced  pendulum 
example  in  section  3  we  show  numerically  that  basin{A}  does  include  such  an 
invariant  Cantor  set  of  curves. 

We  will  be  studying  transient,  regions  in  cases  where  the  trajectory  through 
alniost  every  initial  point  eventually  leaves  the  region.  We  investigate  special 
trajectories  that  remain  in  such  a  transient  region  for  all  positive  time.  In 
[BGOYY],  [GNOY]  a  numerical  method  (involving  the  bisection  procedure)  for 
finding  trajectories  on  the  basin  boundary  was  presented.  The  papers  [NYl],  [NY2] 
introduced  the  PIM  triple  (refinement)  procedure  and  the  accessible  PIM  triple 
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(refinement)  procedure.  Both  these  refinement  procedures  enable  us  to  obtain 
numerical  trajectories  and  accessible  numerical  trajectories  respectively,  that  stay 
(for  positive  time)  in  a  specified  transient  region  in  M.  In  [NY2]  these  two 
refinement  procedures  were  shown  to  be  valid  for  uniformly  siddle-hyperbolic 
dynamical  systems,  for  which  the  dimension  of  the  unstable  manifold  of  any 
nonwandering  point  iii  the  transient  region  was  assumed  to  be  one  dimensional. 

Let  be  a  tranrient  region  for  F.  The  stable  set  S{R)  oiF\s  (x  e  F  :  F"(a:)  e'F  for 
/i,=  0, 1, 2, . .  v);  the  unstable  set  U{R)  of  F  is  {xeR:F~''(x)  eR  for  n  = 
0, 1,  2, . . The  set  of  points  x  for  which  F"(jc)  is  in  R  for  all  integers  n  is  called  the 
invariant  set  iiiv(R)  of  F  in  R,  that  is,  Ihv(/?)  =  5(F)  n  U{R),  A  component  of  5(F) 
(resp.  t/(F))i  \yhich  contains  a  point  of  inv(F)  is  called  a  stable  (resp.  unstable) 
segment.  We  call  Inv(F)  a  chaotic  saddle  when  it  includes  a  Cantor  set.  These 
notions  are  illustrated  in  the  following  example. 

Example  U  An  S-shaped  horseshoe  map  is  an  invertible  map  that  squeezes, 
stretches  and  folds  a  rectangle  into  an  S-shape  area  as  illustrated  in  the  figure  below. 
We  consider  the  S-shaped  horseshoe  map  g,  which  is  defined  on  a  neighbourhood  of 
a  compact,  connected  set  W,  where  W  is  the  union  of  a  rectangle  E  and  the  two  half 
disks  and  Dg  as  indicated  in  the  figure.  Assume  (1)  g  maps  W  into  its  interior, 
(2)  the  intersection  g{E)nE  consists  of  three  horizontal  strips,  say  Hu  Hi  and  //j, 
and  (3)  the  half  disks  Da  and  Dg  include  fixed  point  attractors  A  and  B  respectively. 
Let  1^1,  Vi  and  V3  be  the  vertical  stVips  in  £  (stretching  the  full  width  of  £)  such  that 
'''1)  =  Hi,  1  =5  j «  3;  see  figure  1. 

It  is  well  known,  see  e.g.  Guckenheimer  and  Holmes  [GH],  that  under 
reasonable  assumptions,  almost  every  point  wijl  be  attracted  to  either  A  or  B,  the 
stable  set  5(£)  of  g  with  respect  to  £  is  a  Cantor  set  of  vertical  curves,  and  the 
unstable  set  U{E)  of  g  with  respect  to  £  is  a  Cantor  set  of  horizontal  curves.  All 
components  of  5(£)  are  stable  segments,  and  all  components  of  U{E)  are  unstable 
segments.  The  intersection  C  of  the  stable  set  5(£)  with  the  unstable  set  U{E)  in  £ 
is  a  chaotic  saddle.  Note  that  all  the  points  on  the  chaotic  saddle  C  stay  in  the  box  £ 
for  all  time  under  all"  forward  and  all  backward  iterates  of  the  map  g.  The  set  of 
points  in  £  that  are  on  the  basin  boundary  is  the  stable  set  5(£),  and  the  basin 
boundary  of  g  is  fractal.  One  might  choose  the  transient  region  F  to  be  the  interior 
of  W  minus  two  small  closed  balls  that  are  centred  at  the  attractors  A  and  B. 


Figure  1.  S-shape  horseshoe  map:  vertical  strips  in  the  rectangle  £  are  mapped  into 
horizontal  strips  in  E,  namely  '■'.V',)  =  //,,  f(V’2)  =  //2,  and  F{Vi)  =  Hy  The  half  disks 
Da  and  Dg  each  contains  a  fixed  point  attractor,  and  each  is  mapped  into  its  interior. 
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We  assume  throughout  that  (1)  for  the  transient  region  R  the  set  inv(/?)  ii 
non-empty,  and  (2)  there  exist  two  generalized  attractors  A  and  B;  and  each  point 
in  ^  that,  escapes  from  R  under  iteration  of  the  map  f  is  either  in  basin{/4}  or  in 
basin{B},  and  the  basin  boundary  is  the  common  boundary  of  basih{/l}  and^ 
basin(B}. 

We  will  refer  to  R\S{R),  the  complement  of  the  stable  set  S{R)  in  the  transient 
region  f?,  as  the  transient  set.  Recall  that  a  point  p  in  S(R)  is  accessible  from  an  open 
set  rif  there  is  a  continuous  curve  /C  ending  at  p  such  that  K\{p}  is  in  V.  We 
investigate  the  cases  where  V  is, either  basin  (A)  (or  basin{fl})  or  is  the  transient  set 
R\S{R).  In  this  paper  we  emphasize  points  accessible  from  basin{A}  rather  than 
from  basin(5},  just  to  simplify  notation.  Obyiousjy,  if  a  point  p  in  S{R)  is  accessible 
from  the  transient  set  7?\5(R)  and  p  is  on  the  basin  boundary,  then  p  is  accessible 
from  either  basin{A}  or  basin{B}.  On  the  other  hand,  S{R)  can  contain  points 
which  are  not  in  the  basin  boundary,  and  such  points  might  be  so  numerous  that 
they  block  the  access  to  the  basin  boundary,  that  is,  every  curve  in  basin{A}  that 
goes  to  an  accessible  point  would  necessary  pass  through  points  of  S{R),  Thus  ho 
points  of  the  basin  boundary  would  be  accessible  from  R\S{R).  Naturally  S{R) 
would  have  its  own  accessible  points,  but  these  would  lie  in  basih{A}  (or  basin(5}). 
This  situation  occurs  in  the  previously  mentioned  pendulum  example.  Hence,  S{R) 
might  contain  points  on  the  basin  boundary  that  are  accessible  from  basin(A}  (or 
basin(B})  but  not  accessible  from  the  transient  set  R\S{R).  In  example  2  below, 
5(i?)  contains  such  points  in  the  basin  boundary.  Therefore,  the  accessible  PIM 
triple  procedure  (NY2j  for  finding  accessible  points  on  S{R)  is,  generally  speaking, 
not  a  procedure  for  finding  accessible  points  on  the  basin  boundary.  We  would  like 
to  point  out  that  there  are  cases  where  S(jR)  equals  the  set  (basin  boundary  n/?), 
(though  this  condition  may  be  hard  to  verify).  In  such  cases  the  ASST  method 
(involving  the  accessible  PIM  triple  procedure)  might  be  used  for  finding  accessible 
trajectories  on  the  basin  boundary. 

Example  2.  In  this  example,  we  illustrate  the  fact  that  S{R)  can  contain  points  that 
are  not  in  the  basin  boundary,  and  for  simplicity  we  present  one-dimensional  maps. 
Consider  two  one-dimensional  maps  with  attractor  A  (which  is  -«)  and  attractor  B 
(which  is  +<»).  Let  f  and  g  be  the  piecewise  linear  maps  of  which  the  graph  is  given 
in  figure  2(a)  and  2(h)  respectively,  such  that  g{y)  -  f{y)  for  all  >>=5  1. 


Figure  2.  One-dimensional  maps  f  and  g  (the  graphs  of  f  and  -g  are  given  in  2(a)  and 
2(d»)  respectively).  When  we  choose  the  transient  region  R  to  be  the  interval  (-2,3),  the 
stable  set  S(R;f)  equals  the  basin  boundary,  and  the  stable  set  S(R\g)  is  strictly  larger 
than  the  basin  boundary. 


4* 

Accessible  trajectories  on  basin  bdundaries  087 

Let  p  and  q  denote  the  two  fixed  points  of  g  in  (1, 9°),  and  write  m  = 
i&p}.  Assume  1  <m  <2<p  <9  <3<g(m),  see  figure  2.  The  maps  are 
constructed  in  such  a  way  that  basin{A}  and  basin{5}  of  g  and  /  coincide^  Hence, 
both  maps  have  the  same  basin  boundary  and  it  is  contained  in  the  interval  [-1, 1], 
Note  that  the  basin  boundary  is  the  set  of  all  points  in  [-1,  IJ'that  stay  inside  [-1, 1] 
under  all  positive  iterates  of  the  map  /(or  g),  and  the  basin  boundary  is  fractal. 

On  the  other  hand  we  have,  all  points  in  (!,«>)  go  to  attractor  B  under  forward 
iteration  of  the  map  /,  whereas  basin  {13}  for  g  includes  a  chaotic  saddle  in  the  open 
interval  (2,3).  When  we  choose  the  transient  region  R  to  be  the  open  interval 
(-2,3),  the  stable  sets 'S(/?;/)  and  5(1?;  g)  are  the  sets  of  points  that  stay  in  R 
under  all  forward  iterates  of  /  and  g  respectively.  We  have  the  basin  boundary 
equals  the  stable  set  5(/?;/),  but  the  stable  set  5(/?;g)  is  strictly  larger  than  the 
basin  boundary.  It  can  be  shown  that  points  of  5(/?;g)-5(/?;/)  can  be  found 
arbitrarily  close  to  each  point  of  the  basin  boundary. 

We  would  like  to  address  the  following  problem. 

Accessible  basin  boundary  static  restraint  problem.  Given  a  segment  J  that  has 
one  end  point  in  basin(A)  and  one  end  point  in  basii^fi),  describe  a  procedure  for 
finding  a  point  on  the  basin  boundary  (in  JDS{R))  which  is  accessible  from 
basin{A}. 

We  will  state  a  procedure  (the  accessible  basin  boundary  refinement  procedure) 
for  finding  accessible  points  in  M  on  the  basin  boundary.  We  will  show  it  is  valid 
(guaranteed  to  work)  for  the  same  class  of  hyperbolic  dynamical  systems  as  in 
(NY2J,  namely  hyperbolic  systems  in  which  the  unstable  manifolds  are  one 
dimensional. 

All  the  procedures  are  based  on  our  presumed  ability  to  specify  an  initial  point  p 
and  compute  the  time  Tr{p)  its  trajectory  takes  to  escape  from  R.  For  applications, 
we  need  a  ‘dynamic’  version  of  the  ‘static’  problem  above,  since  we  want  to  produce 
numerical  trajectories  that  are  accessible  from  basin{A).  The  ‘dynamic’  problem 
that  is  associated  with  the  ‘static’  one  is  the  following. 

Accessible  basin  boundary  dynamic  restraint  problem.  Given  a  line  segment  J 
that  has  one  end  point  in  basin{A)  and  the  other  end  point  in  basin{B),  describe  a 
procedure  for  finding  a  numerical  trajectory  on  the  basin  boundary  that  starts  on  J 
and  which  is  accessible  from  basin{A). 

The  ideas  of  the  ‘accessible  basin  boundary  refinement  procedure’,  which  solved 
the  ‘static’  problem,  can  be  applied  to  solve  the  ‘dynamic’  problem,  in  such  a  way 
that  implementation  is  possible  on  a  computer.  For  more  details,  see  the  discussion 
in  section  6. 

The  organization  of  the  paper  is  as  follows.  In  section  2  we  present  the 
‘accessible  basin  boundary  refinement  procedure’.  Then,  m  section  3,  we  discuss 
some  examples  in  which  the  straddle  method  involving  this  refinement  procedure 
has  been  used.  The  main  result  for  the  validity  of  the  refinement  orocedure  for 
hyperbolic  systems  is  stated  precisely  in  section  4,  and  this  result  is  proved  in  section 
5.  Section  6  is  devoted  to  the  discussion  of  the  associated  numerical  method  (the 
accessible  basin  boundary  straddle  trajectory  method  or  ABST  method)  and  related 
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numerical  methods.  Finally  in  section'  7^  the  case  of  d-dimensional  hyperbolic 
systems,  d&3,  and  smoothness  of  F  are  discussed; 


2.  The  accessible  basin  boundary  retoement  procedure 

Let  the  manifold  M,  the  diffeomofphism  F,  the  tr  lent  region  R,  and  generalized 
attractors  A  and  be  as  before.  Recall  that  we  as;-  ..o  that  each  point  that  leaves  R 
under  iteration  of  Fis  either  in  basin{/l}  or  in  basin(R}.  The  escape  time  Tff{x)  of  a 
point  x>in  R  is  defined  by  t/i(x)  =  min{/t  5=  I  ;F"(jc)  i  R},  and  T/i{x)  =  » if  F"(x)  e  R 
for  all  n  ^  1.  We  say,  Tfi(x)  =  0  if  .t  i  R, 

Let  /  be  an  unstable  segment  in  R,  The  notation  {x,  y}  for  a  pair  means  that  x 
and  y  lie  on  J.  Since  J  is  homeomorphic  to  an  interval,  we  may  assume  it  has  the 
ordering  of  an  interval.  For  {jc,  y}  we  always  assume  for  convenience  that  the 
ordering  on  J  is  such  that  we  may  write  a:  <y,  and  denote  [ac,  y)y  for  the  segment  on 
7  joining  a:  and  y.  Let  Led  be  any  connected  subset  of  7.  Assume  L  intersects  the 
stable  set  S(R)  transversally,  and  let  {a,b)  be  a  pair  on  L  For  each  £>0,  an 
e-refinement  of  {a,b)  is  a  finite  set  of  points  a=go<gi<'  "<gN-  b  in  [a,b]j 
such  that 

(e/2)  •  p({a.  b]j)  ^  p(\gk,  g*+,ly)  e  •  p((a,  b]j) 
fornWk.Q^k^N-l. 

We  say  the  pair  (a,  b)  is  a  straddle  pair  if  a  6basin{/li}  and  b  6  basin{B}.  We 
call  {a,  b)  a  proper  straddle  pair  if  (a,  b}  is  a  straddle  pair,  and  at  least  one  of  the 
points  a  and  b  is  in  the  interior  of  L,  If  {a,  b}  is  a  (proper)  straddle  pair,  then  we 
call  the  interval  (a,  b]j  a  {proper)  straddle  segment.  Our  objective  is  to  describe  the 
‘accessible  basin  boundary  refinement  procedure’  that  selects  in  a  unique  way  a 
proper  straddle  pair  from  any  e-refinement  of  a  given.straddle  pair  (on  J).  When  we 
repeatedly  apply  the  procedure  to  the.  end  points  of  the  ever  decreasing  straddle 
segments  (with  lengths  converging  to  zero),  the  resulting  nested  sequence  converges 
to  an  accessible  point  p  in  the  basin  boundary;  of  course,  this  point  p  is  in  Jr\S{R). 
The  point  p  that  we  find  is  accessible  using  the  curve  [r,p]j  for  some  r  in 
7nbasin{A},  so  we  say  p  is  ‘accessible  from  the  left’  (‘accessible  from  basin{A}’), 
that  IS,  from  the  side  containing  r  (in  basin(A)).  We  could  alternatively  have  chosen 
to  approach  from  the  right  and  we  would  expect  to  find  a  different  point  on  the 
basin  boundary.  Since  almost  every  point  oh  7  has  finite  escape  time  (see  section  4), 
we  can  assume  that  all  points  of  all  refinements  are  cho.sen  with  finite  escape  time. 

We  now  describe  the  accessible  basin  boundary  refinement  procedure  which  is 
the  refinement  procedure  that  generates  a  uniquely  defined  proper  straddle  pair 
from  a  given  straddle  pair.  This  procedure  plays  a  dominant  role  in  the  method  that 
generates  a  numerical  trajectory  on  the  basin  boundary  that  is  accessible  from 
basin{A}.  A  slightly  improved  version  is  stated  in  section  4. 

Let  {a,  b)  be  a  straddle  pair  on  a  curve  segment  7  such  that  a  is  contained  in 
basin(/l},  and  b  is  contained  in  basin{B}.  Let  F=  {Af,-;0«/«A/(e)}  be  any 
e/3-refinement  of  {a,  b),  we  of  course  have  Fc7  and  a  =Aro<A:i  <. . .  <Xs(e)  =  b. 
We  choose  the  proper  straddle  pair  {a*,  b*}  from  P  in  the  following  way: 

(1)  select  b*  to  be  the  leftmost  point  of  P  that  is  in  basin{B}; 

(2)  define  m  to  be  the  minimum  of  the  escape  time  of  the  points  in  P  to  the  left 
of  b*,  and  write  a°  to  denote  the  rightmost  point  to  the  left  of  b*  that  has  the 
minimum  escape  time  m. 
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(2a)  If  m  <T/j(a)  then  choose  a*  =  a“;  otherwise, 

(26)  if  m:='TR(fl)  then  the  choice  of  a*  depends  on  the  grid  P*  consisting  of  b* 
and  all  the  points  in  P  to  the  left  of  6*  (that. is,,  P*  =  {x^P'.xe  [a,  6*)}). 

(i)  If  the  grid  P*  is  hot  an  e-refinement  of  {a,b*},  then  choose  d*=a\ 
otherwise, 

(ii)  if  the  grid  P*  is  an  e-refihement  of  (a;  b*)  then  choose  a*  to  be  the  adjacent 
point  in  P*  to  the  right  of  unless  b*  is  that  adjacent  point,  in  which  case  choose 
a*  =  a**. 

Remark.  Assume  that  e>()  is  suitably  chosen.  In  case; of  step  (26)  the  equality 
does  hot  occur  and  one  has  a*  >  a“. 

(1)  As  the  accessible  basih  boundary  refinement  procedure  is  applied,  re¬ 
peatedly,, step  (2a)  only  occurs  at  most  fihitely.many  tirhes,  ahd  the  segrhent  (a,  a*j 
in  (2a)  may  include  points  that  are  in  basin{P}.  However,  once  step  (26)  occurs, 
step  (2a)  will  never  occur  again.  When  step  (26)  is  applied,  the  entire  segment 
(a,  a*)  (noi  ust  the  grid  pojnts)  is  in  basin{A}  .but'[a,  a*].may  include  points  that 
have  escape, Hme  infinity.  We  would,  like  to  emphasize  that  all  the  points  between  a 
and.a*  in  step\26)  whose  escape  time.is  finite,  go  to  attractor  A.  This  is  why  the 
method. produces  ah  accessible  point  as.  the  refinement  is  repeated.  The  problem  of 
course  is.  to  find  e  small  enough. 

(2)  When  a*  and  6*  have  been  chosen,  if'the  grid  consisting  of  o*.  6*!  and  all 
the  points  in  P  between  a*  and  6*  is  still  an  e-refinement  of  the  pair  {a*,  6*},  then 
set  a*  =  a  and.6*.-6  and  apply  step;(26).  Repeat  this  until  the  grid  {xeP'.xe 
[a*,  6*j}  fails  to  be  an  e-refinement  of  (a*,  6*}.  Notice  that  in  cases  when  only  step 
(26)  is  repeated,  the  point  6  does  hot  move. 

(3)  Under  hypotheses  in  section.  4,  it  is  possible  to  repeatedly  apply  the 
accessible  basin  boundary  refinement  procedure  obtaining  a  sequence  of  straddle 
pairs  that  converges  to  an  accessible  point  onJhe  basin  boundary. 

Example  3.  The  purpose  of  this  example  is  to  illustrate  the  accessible  basin 
boundary  refinement /procedure  in  a  graphical  way.  We  choose  e  =  0.1.  Let  {a,  6} 
be  a  straddle  pair,  and  let  P  be  an  e/S-refinemeht  of  {a,  6).  We  assume  that  P  is  on 


Tr 


Tr 


*  m 

m  * 


« 


« 


» 


*  • 


* 


b* 


b 


a 


Figve3.  The  accessible  basin  boundary  refinement  procedure.  In  figure  3(a)  the  grid 
on  [a,  6*]  is  not  an  e-refinement  of  {n.  h*}  and  so  a  does  not.^move;  in  figure  3(h)  the 
grid  on  [a,  h*)  is  an.e-fsfinement  of  (a,  h*}  and  so  a  moves  to  the  right. 
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the  str  ght  line  segmenr  that  joins  a  with  b  and  that  the  grid  points  are  equally 
spaced,  so  P  consists  of  31  grid  points.  In  figure  3  the  escape  time  of  a  grid  point  x  in 
P  is  represented  by.a  star  if  x  is  in,  basin{/l},,  and  it  is  represented  by,  a  dot  if  a:  is  in 
basin{B}. 

In>  figure  3(a)  we  have  b*=JC8.  The  grid  P*  =  {A:6P:A:6{a,  il>*]};  is  hot  an 
e-refinement  of  {a,b*},  since  the  distance  between  two  adjacent  points  equals 
||h*  -  ajj/8  which  is  greater  than  e  •  ||f)*  -  a||.  Hence,  we  choose  a*  =  a.  In  figure 
3(6)  we  have  b*=X2Q.  The  grid  P*  =  (a;  eP:jc6{a,  6*)}  is  an  e-refinement  of 
(a,  6*}‘,  since  the  distance  between  two  adjacent  points  equals  ||6*  -  al|/20  which  is 
smaller  than  e  •  ||6*  -  a||.  Since  T«(a:o)  =  Th{Xh)  -  Tk{xw)  =  m,  we. choose  a*  =  Xn 
as  indicated  in  the  figure. 


3.  Applications 

The  objective  of  the  pajptr  is  to  present  the  accessible  basin  boundary  refinement 
procedure  which  enables  us  to  obtain  accessible  numerical  trajectories  on  the  basin 
boundary.  We  also  prove  that  this  numerical  prc'^dure  works  in  ideal  cases.  While 
we  beljeve  that  the  hyperbollcity  hypotheses  (stated  in  section  4)  are  often  satisfied, 
they  are  nonetheless,  in  practice  difficult  or  impossible  to  verify.  While  chaotic 
attractors  are  usually  not  hyperbolic,  the  sets  we  look  at  are  not  attractors.  We  do 
observe  that  frequently  we  can  successfully  use  the  procedure  to  obtain  pictures  of 
the  accessible  points  on  the  basin  boundary. 

In  all  the  examples  below,  the  pictures  were  obtained  by  using  the  Dynamics 
Program  [Y|.  In  these  pictures,  basin(Y^}  is  obtained  as  follows:  for  a  9^x544 
grid,  use  each  grid  point  as  initial  value  and  assign  to  each  grid  . point  a  colour 
(respectively,  no  colour)  if  its  trajectory  converges  to  X  (respectively,  stays  away 
from  X).  TTte  set  of  coloured  grid  points  is  in  basin{Jf},  and  the  non-coloured  grid 
points  are  outsit’  If*  all.  the  pictures  for  which  one  of  the  numerical 

procedures  has  be  jplied  in  order  to  produce  a  single  numerical  trajectory,  have 
been  obtained  by  selecting  e  =  1/30  as  default  value  (see  also  section  6). 


3.1,  Henonmap 

Let  the  diffeomorphism  F  acting  on  the  plane  be  given  by 

\ 

Hx,  y)  =  ip-x^  +  p-y,  x). 

The  map  F  is  equivalent  under  a  change  of  variables  to  the  H^non  map 
(l-p’X^+Y,  p-  X).  For  a  first  example,  we  choose  the  parameters  p  = 
1.81257970  and  p  =  0.022  864  30;  these  parameters  are  due  to  Grassberger  and 
Cvitanovic  (personal  communication).  For  these  parameters  attracting  cycles  with 
period  3  and  period  5  coexist.  Let  and  D2  be  closed  balls  of  radius  0.01  centred  at 
one  of  the  points  of  the  attracting  period  3  cycle  and  5  cycle  respectively.  We  choose 
the  transient  region  R  to  be  the  open  set  {(x, y):—2<x<2,  -4 < y  < 4}  minus  the 
closed  balls  and  £>2. 

Let  A  and  B  be  the  attractors  with  period  3  and  period  5  respectively.  The  white 
area  in  figure  4(a)  is  basin{/l};  the  black  area  is  basin{fl}.  By  using  the  bisection 
procedure  (see-also  section  6),  we  obtain  a  straddle  trajectory  (that  is,  a  numerical 
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Hgwt  4.  (a)  The  white  area  is  basin(/l)  and  includes  the  period  3  attractor,  the  black 
areaisbasm{fi}  and  includes  the  period  S  attractor  in  the  region  -2<x<2,  -4<y<4 
of  the  Hdnon  map  with  parameter  values  1,81257970,  /r  =  0,022  864  30.  (6) 
Straddle  trajectory  using  the  bisection  procedure  for  the  Hdnon  map  (p  -  1.81257970, 
Pb0,0228M30)  in  the  transient  region  ((jf,y):  -2<x<2,  -4<y<4}  minus  two 
closed  bails  of  radius  0,01  centred  at  a  point  of  each  attractor.  The  three  saddle  periodic 
points  on  the  basin  boundary  that  are  accessible  from  basih{<4}  and  the  live  saddle 
periodic  points  on  the  basin  boundary  that  are  accessible  from  basinjfi)  are  indicated  by 
straight  and  curved  arrows  respectively,. 

trajectory)  on  the  basin  boundary  consisting  of  more  than  100  000  points  (actually 
tiny  intervals);  the  result  is  presented  in^hgure  4(b). 

By  using  the  accessible  basin  boundary  refinement,  procedure  we  obtain  a  period 
3  saddle  when  the  left  point  a  is  chosen  in  basin{/l),  and  a  period  5  saddle  when  the 
left  point  p.is  chosen  in  basin{B).  The  accessible  period  3.ahd  period  5  saddles  on 
the  chaotic  saddle  are  indicated  by  arrows  in  jgure  4(b).  Therefore,  the  set  of  all 
points  accessible  from  basin  {/!}  are  the  stable  manifolds  of  the  points  of  the  period 
3  saddle,  and  all  points  accessible  from  basih{B}'  are  the  stable  manifolds  of  the 
points  of  the  period  5'  saddle. 

For  a  second  example,  we  select  the  values  p  =  2;66,  p  =  0.3.  The  map  Fhas  two 
attractors  vl  and  B,  where  /I  .  and  B  denote  the  attractors  infinity  and  a  cycle  with 
period  3  respectively.  The  box  {(x,.y):--3<j;<3,  t3<>’<3)  contains  a  chaotic 
saddle,  and  we  select  the  transient  region  R  .to  b.'  the  open  set  {(x,  >’):-3<x<3, 
-3  <>'.<3}  mjnus  the  ball  of, radius  0.005  centret  at  a  point  of  attractor  B.  Using 
the  bisection  procedure  results  in  one  nunierical  trajectory,  that  has  been' prc-sented 
in  figure  5. 

By  using  the.accessible  basin  boundary  refinenient  procedure-we  obtain  a  period 
1  saddle  when  the  left  point.a  is  chosen  in  basin{A},  and  a  period  3  saddle  when  the 
left  point  chosen  in  basin{iB}..  The  accessible  period  1  and  period  3  saddles  on 
the  chaotic  saddle  are  indicated  by  aiTOws  in  figure  S.  So,  the  set  of  all  points 
accessible  from  basin{i4}  is  the  stable  manifold  of  the.period  1  saddles  and  the  set  of 
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Flgiuc  5.  Straddle  trajectory  usinj  the  bisection  procedure 
for  the  Hdnon  map  (p  =  2.66,  pa 0.3)  in  the  transient 
region  {(*,  y) :  -3  <  x  <  3,  -3  <  y  <  3)  minus  a  closed  ball 
of  radius  O.OOS  centred  at  a  point  of  attractor  B  (the 
period  3  attractor).  The  fixed  point  on  the  basin  boundary 
that  is  accessible  from  basin{/t}  (where  /!=»),  and  the 
three  saddle  periodic  points  on  the  basin  boundary  that 
are  accessible  from  basin{B)  are  indicated  by  curved  and 
straight  arrows  respectively. 


all  {joints  accessible  from  basin{fi}  are  the  stable  manifolds  of  the  points  of  the 
period  3  saddle. 

For  a  third  example  of  this  map,  we  select  the  parameter  values  p  =  1.405, 
p  =  -0.3.  The  map  F  has  two  coexisting  attractors,  namely,  a  period  2  cycle 
(attractor  /I)  and  the  attractor  infinity  (attractor  B).  The  box  {(jc,y):-3<x<3,  ■ 

-3<y<ll}  contains  a  chaotic  saddle.  Basin(/1}  is  the  white  area  in  figure  6(o)  i 

(the  two  points  of  attractor  A  are  marked  by  a  dot  in  the  figure),  and  basin{B}  is  ^ 

black  in  figure  6((i). 


r 


Figue  6.  (a)  The  white  area  is  basin(A}  and  includes  the  period  2  attractor,  the  black 
area  is  basinfS}  (where  fl  =  o>)  in  the  re^on  {(x,y):-3<x<3,  -3<y<ll}  of  the 
Hinon  map  with  parameter  values  p  =  1.405,  p  =  -0.3.  Attractor  A  is  marked  by  two 
dots,  and  a  saddle  fixed  point  in  basinfA)  is  marked  by  a  cross.  (f>)  Straddle  trajectory 
using  the  bisection  procedure  for  the  H^non  map  (p  =  1.405,  p  =  -0.3)  in  the  transient 
region  {(x,y):-3<x<3,  -3<y<ll}  minus  a  closed  ball  of  radius  0.2  centred  at  a 
point  of  attractor  A.  The  three  saddle  periodic  points  on  the  basin  boundary  that  are 
accessible  from  basinfA)  and  the  sadde  fixed  point  on  the  basin  boundary  that  is 
accessible  from  basinfB}  are  indicated  by  straight  and  curved  anows  respectively. 
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We  select  the  transient  region  R  to  be  the  open  set  {{x,y)'.-3<x<3, 
-3<y<  11}  rnjnus  the  ball  of  radius  0.2  centred  at  a  point  of  attfactor  A.  Using  the 
bisection  procedure  results  in  one  numerical  trajectory,  that  has  been  presented  in 
figure  6(b),  The  PIM  tripje  procedure  may  result  in  a  saddle  fixed  point  that  is  in 
basin{A};  this  saddle  point  is  marked. by  a  cross  in  figure  6(«).  If  we  select  the 
transient  region  to  be  the  region  R  minus  a  ball  of  radius  0.2  centred  at  this  saddle 
fixed  point,  then  applying  the  PIM  triple  procedure  results  a  similar  numerical 
trajectory  as  in  figure  6(&).  Notice  that  the  ball  including  the  saddle  fixed  point  is  in 
basin  (A). 

By  using  the  accessible  basin  boundary  refinement  procedure  we  obtain  a  period 
3  saddle,  when  the  left  point  «  is  chosen  in  basin{A},  and  a  period  I  saddle,  when 
the  left  point  a  is  chosen  in  basin{B}i  The  points  of  the  accessible  period  3  saddle 
on  the  chaotic  saddle  are  indicated  by  arrows  in  figure  6(a).  So.  the  set  of  all  points 
accessible  from  basin{A}  are  the  stable  manifolds  of  the  points  of  the  period  3 
saddle,  and  the  set  of  all  points  accessible  from  basin {fl}' is  the  stable  manifold  of 
the  period  !  saddle. 

Note  that  the  invariant  set  of  points  in  the  transient  region  consists  of  at  least 
three  basic  sets,  namely,  (1)  the  period  2.attractor,  (2)  the  saddle  fixed  point  .’h 
basin(A}  and  (3)  the  chaotic  saddle  on  the  basin  boundary. 

J.2.  Pendulum 

We  consider  the  differential  equation 

x"(i)  +  vx'(t)  +  sinar(r) » /  cos(r). 


(a)  (b) 


Figure  7.  (a)  The  white  area  is  basin{/l}  and  the  black  area  is  basin{B}  (where 
=  (-0.472 615,  2.037084)  and  B  =  (-0.478014,  -0.608233)  are  fixed  point  attrac¬ 
tors)  in  the  region  {(x,>>):-;r<x<.T,  -.3 <>><4}  of  the  time-2;t  map  of  the  forced 
pendulum  j:'(r)  +  0.2x'(r)  +  sinx(r)  =  2ccs(t).  The  three  saddle  periodic  points  on  the 
basin  boundary  that  are  accessible  from  basin{/4}  are  indicated  by  arrows,  (b)  Two 
straddle  trajectories  using  the  PIM  triple  refinement  procedure  for  the  time-2;r  map  of 
x''(0  +  0.2x'(t)  +  sin  x(t)  =2  cos(t)  in  the  transient  region  {(x,  y) :  -;r  < x  <  ,t,  -3  <>>  < 
4)  minus  two  closed  balls  of  radius  O.OS  centred  at  the  fixed  point  attractors  A  and  B, 
one  trajectory-in  both  basin{/l}  and  basin(B}.  The  two  saddle  periodic  2  orbits  on  the 
stable  set  that  are  accessible  from  the  transient  set  R\S{R)  are  indicated  by  arrows. 
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We  choose  the  parameter  values  v  =  0.2  and  /  =,2.  For  these  parameters,  the 
t|me>2;r  map  has  two  stable  fixed  poin^  A  and  B.  In;  figure  7(a),  basm{/l}  is 
coloured  white  and  basin{5}  is  coloured  black.  It  was  already  observed  [GOY2] 
that!  there  was  transient  behaviour  in  the  bastn{/l}  and  basin{B}.  We  choose  the 
transient  region  to  be  the  rectangle  {{x,y):-n<x  Ct,  -3<y<'4}  minus  two 
balls  (of  radius  0.05)  centred  at  the  attractors  A  and  B.  By  using  the  PIM  triple 
procedure  for  two  different  transient  regions,  we  obtain  two  numerical  trajectories. 
The  result  for  the  choice  of  the  interval  with  end  points  (-3,  -3)  and  (3,4)  is. a 
trajectory  lying, in  basin(i4}i  and  the  segment  from  (-3,4)  to  (3,  -3)  results  in  a 
numerical  trajectory  lying  in  basin  (fl).  Both  trajectories  are  presented  in  figure 
7(6). 

By  using  the  accessible  PIM  triple  procedure  we  obtain  period  2  saddles,  see  also 
the  discussion  in  section  6.  the  result  for  the  segment  from  (-3,  -3)  to  (3,4)  is  a 
period  2  saddle  on  the  chaotic  saddle  in  basih{/l}.  and  the  segment  from  (-3. 4)  to 
(3,  -3)  results  in  a  period  2  saddle  on  the  chaotic  saddle  in  basinjfl}.  The  points  of 
these  accessible  period  2  saddles  on  the  chaotic  saddle  are  indicated  by  arrows  in 
■figure  7(6),  The  set, of  all  accessible  points  on  the  two  chaotic  saddles  arc  the  stable 
manifolds  of  the  points  of  these  period  2  saddles. 

By  using  the  accessible  basin  boundary  refinement  procedure  we  obtain  two 
period  3  saddles:  one  is  accessible  from'basin(/I},  and  the  other  one  is  accessible 
from  basinjfl}.  The  points  of  the  period  3  saddle  that  is  accessible  from  basin{/4} 
and  is  on  the  basin  boundary,  are  indicated  by  arrows  in  figure  7(o).  The  set  of  all 
points  on  the  basin  boundary  that  are  accessible  from  basin{/I},  are  the  stable 
manifolds  of  the  points  of  this  period  saddle.  A  similar  result  as  above  holds  for  the 
points  on  the  basin  boundary  that  are  accessible  from  basin{fl}. 


3.3.  Complex  quadratic  map 


We  consider  the  quadratic  map  in  the  complex  plane  given  by 
z„+i  =  2n  +  0.32  +  0.043f. 

For  this  system  two  attractors  coexist,  namely,  a  period  11  attractor  (attractor  A) 
and  the  attractor  infinity  (attractor  B).  Let  D  be  a  closed  ball  of  radius  0;05  centred 
at  a  point  of  attractor  A.  We  choose  the  transient  region  R  to  be  the  open  set 
{(x, y):- 1.35 <Ar<  1.35,  -1.35<y<  1,35}  minus  the  ball  D.  The  basin  boundary 
straddle  trajectory  resulting  from  the  bisection  procedure  is  presented  in  figure  8(a). 
The  accessible  basin  boundary  straddle  trajectory  resulting  from  the  accessible  basin 
boundary  refinement  procedure,  a  trajectory  of  which  all  the  points  are  accessible 
from  basin{A}  is  presented  in  figure  8(6),  and  the  accessible  basin  boundary 
straddle  trajectory  of  which  all  the  points  are  accessible  from  basin{B}  is  presented 
in  figure  8(c). 

The  choice.of  this  equation  was  motivated  by  the  picture  of  the  Julia  set  in  [PR]. 
The  reader  should  compare  our  figure  8(a)  with  figure  25  in  [PR].  We  would  like  to 
point  out  that  the  basin  boundary  of  this,  system  (the  Julia  set)  is  two  dimensionally 
unstable;  thus  our  results  are  not  valid  for  this  example. 
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Figure  8.  (a)  Straddle  trajectory  using  the  bisec¬ 
tion  procedure  for  the  complex  quadratic  map 
=  + 0.32  +  0.043/  in,  the  transient  region 

((•».  >’):-1.35<x.  y  <  1.35}  minus  a  closed  ball  of 
radius  0.05  centred  at  one  of  the  points  of  attractor 
A  (period  11  attractor),  (b)  Straddle  trajectory 
using  the  accessible  basin  boundary  refinement 
procedure  for  the  complex  quadratic  map  that  is 
accessible  from  basing},  (c)  Straddle  trajectory 
using  the  accessible  basin  boundary  refinement 
procedure  foi  'ihp  complex  quadratic  map  that  is 
accessible  from  Dasin{/}). 


4.  Results 


In  section  2  we  presented  the  accessible  basin  boundary  refinement  procedure  for 
finding  a  point  on  the  basin  boundary  in  the  transient  region,  which  is  accessible 
from  basin{i4}.  First,  we  formulate  a  refinement  procedure  which  is  a  slightly 
improved  version  of  the  accessible  basin  boundary  refinement  procedure. 

We  will  describe  inductively  how  to  refine  our  proper  straddle  pairs.  Given  a 
straddle  pair  {a„,  b„},  we  have  a„  is  contained  in  basin{/l},  and  b„  is  contained  in 
basin{5}.  Given  any  e/3-refinement  P„  =  {x,:0«/^iV(£)}  of  {a„,b„},  we  of 
course  have  a„  =4ro < JCi  <  -  -  -  <XNtt)  =  We  choose  the  next  proper  straddle  pair 
{a„+u  from  P„  in  the  following  way. 

(1)  Select  b„+i  to  be  the  leftmost  point  of  P„  n  basin{P}. 
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(2)  Define  m„  =  mui{7}{(x) :x  e  and  x  <  6„+,}; 

=  max{jc  6  :x  <  6„+,  and  Tk{x) = m„}. 

(2a)  If  m„  <  7^(<i.,)  then  choose  otherwi», 

(2b)  If  =  7}i(ari)  then  in  order  to  choose  we  write 

G„  =  {xeP„:.. 

a,J+,  =  miriimum  of  the  set  (x  e  :a®+,  <x  < 
unless  this  set  is  enipty  in  which  case  a^^,  =a°+,; 

ai+i  =  max{j:  eQ„  -.x<  and  Tk(x)  =  rR(a^+,)}. 

^ase  (i)  If  Q„  is  not  an  e-refinement  of  {a„,  6^+,},  then  choose  a„+,  =a„; 
-wise, 

C^e  (ii)  If  0n  is  an  e-fefinement  of  (Oi,,  h„+|}  then  choose  a„+,  =ai+,. 

Remark  (1)  For  the  convenience  of  the  reader,  if  £>0  is  chosen  suitably,  then 
a„  ^  aS+,  <  aUx  =S ai+,  <  and  =  7'R(a"+,)  <  TR(a,X*d  =  T'^Cai+i)-  Nc  :  that 
Qn  might  fail  to  be  an  e-refiriement  of  {a„,  b„+t}  in  that  the  distance  between  some 
P..ir  of  consecutive  pointe  in  Qn  might  be  bigger  than  e  •  p([a„,  b„+i]j. 

(2)  Under  the  hypotheses  below  it  is  possible  to  repeatedly  apply  the  improved 
u..aement  procedure  above  obtaining  a  sequence  {{a„,  &„}}„»,)  that  settles  down  to 
an  accessible  point  on  the  basin  boundary.. 

In  the  descri^-rion  of  the  refinement  procedure  above,  we  assumed  that  there 
exists  an  e>0  L.  which  every  e-refinement  of  a  straddle  pair  {a„,  b„}  includes  a 
proper  straddle  pair  b„+i}  such  that  (a„,  a„+i)/  is  in  basin{/l},  and  the  length 
of  the.  straddle  segment. (a„+,, s  at  most  (1- e/2)  times  the  length  of  the 
previous  straddle  segment  [a„,  b„]j.  We  will  justify  these  concepts. 

Let  the  i;  lold  Af  and  the  diffeomorphism  F  be  as  in  the  introduction.  We 
assume  that  A  and  B  are  two  generalized  attractors  such  that  each  attractor  is 
contained  either  in  A  or  in  B.  Recall  that  a  subset  A  of  A/  is  hyperbolic  if  it  is  closed 
and  F-invaria-  nd  the  tangent  bundle  T^Af  splits  into  dF-invariant  sub-bundles 
and  E“  on  w  JF  is  uniformly  contracting  and  uniformly  expanding  respectively. 
A  hyperbolic  set  A  is  called  saddle-hyperbolic  if  dim  ^  1  and  dim  £"  >  1.  In 
[NY2]  we  defined  a  tegion  R  to  be  a  saddle-hyperbolic  transient  region  if  R  satisfies 
all  the  following  conditions: 

(Al)  F  is  a  transient  region; 

(A2).  hyperbolicity  property  ;nv(F)  is  a  non-empty  saddle-hyperbolic  set; 

(A3)  boundary  property.  U(R)  D  dR  is  mapped  outside  the  closure  R  of  R; 

(A4)  intersection  property:  each  non-trivial  component  .y  of  U(R)  is  an  unstable 
segment,  that  is,  y  intersects  Inv(F);  note  that  such  a  segment  y  must  intersect  5(F) 
transvefsally. 

In  this  paper,  we  say  a  transient  region  F  satisfies  the  basin  boundary  property  if 
(1)  each  point  in  R\S(R)  is  contained  in  ei'her  basin{A}  or  basin{B},  (2)  the  sets 
F  nbasin{i4}  and  F  H  basin{B}  are  nc  ’mpty,  and  (3)  the  F  n  basin  boundary  is 
positively  invariant  (that  is,  F  maps  i  jasin  boundary  into  itself).  We  define  a 
region  F  to  be  a  basin  boundary  transient  region  if  F  is  a  saddle-hyperbolic  transient 
region  and  F  satisfies  the  basin  boundary  property. 
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For  a  basin  boundary  transient  region  and  e  ^O,  the  properties  (Al)  and 
(A2)  imply  that  the  e^pe.tinie  of  almost  every  point  point  on  an  unstableXsegmeht 
is  finite.  (A  result  due  to  Bowen  and  Rueile  [BR]  shows  that  S{R)  has  l^besgue 
measure  zero.)  Hence,  one  may  assume -that  such  a-rehnement  does  not  intersect 
the  stable  set  .S(R).  The  basin  bounda^  property  implies  that  each  point  that 
escapes  from  R  under  iteration  of  the  map  F  is  either  in  basih{i4}  or  in  basin{B}. 

If  /?  is  a  basin  boundary  transient  region-,  then  the  escape  time  map  Tn  restricted 
to  an  unstable  segment  7  c=  t/(/?)  has  the  following  two  properties  (see  [NY2)). 

(i)  All  the  points  in  a  chosen  segment  [a,  6]y  on  J  will  escape  from  R  if  and  only 
if  no  £-refihement  of  {a,  6}  includes  a  PIM  triple  (that  is,,a  triple  (p,  r,  q):on’J  such 
that  Tn(r)  >  T^ip),  Tn{r)>  and  p([p,  q]j)  <  pi[a,  b]j)). 

(ii)  Tk  is  locally  constant  on  an  open  subset  of-full  measure  of  J,  and  if.  r/j(jc)  <  <» 
and  jc  is  a  point  of  discontinuity  of  then  lim  inf,,_,.  t^^y)  =  f^ix)  and 
lms\ipy^^T„(y).=  TK{x)  +  i. 

We  assume  throughout  that  dim  £“  =  1*.  For,  the  sake  of  simplicity,  we  assume 
that  d  - 2;  the  more  difficult  case  d  ^  3  will  be  discussed  in-scction  7. 

From  how  on,  we  will  assume  that  /?  is  a  basin  boundary  transient  region  for  F, 
and  that  7  c //(/?)  denotes  an  unstable  segment.  The  proof  of  the  proposition 
below,  will  follow  imihediately  Tiom  the  propositions  5.1  and  5.2. 

Proposition-.  There  exists  a  finite  set  of  . periodic  points  P“  in  Inv(/?)  such  that  (1) 
each  point ;in  P“  is  accessible  from  R\S{R),  and; (2)  for  xeS{R),  the  point  x  is 
accessible  from  R\S(R)  if  arid  only  if  x  e  W‘(p)  for  some  p  e  P“. 

Corollary.  Each  accessible  point  on  the  basin  boundary  is  in  the  stable  manifold  of 
some  periodic  point. 

Since  7  is  an  unstable  segment,  recall  that  this  implies  that  both  ends  of  7  are  in 
the  boundary  of  the  transient  region./?.  We  know  by  the  intersection  assumption 
that  7  intersects  the  stable  set  S{R).  Obviously,  if  {a,b}  is  a  straddle  pair,  then 
there  exist  proper  straddle  pairs  in  every  e-refinement  of  {a,  b},  for  each  e, 
0<£=s0.5. 

The  next  result  deals  with  the  convergence  of  the  sequence  of  nested  proper 
straddle  segments  •(a„+,,  h„+,]y  e  [a„,  ri„]y  on  7.  A  sequence  of  straddle  segments 
{[a„,  ri„]y}„so  on  7  is  called  a  straddle  segment  sequence  if  ri„+i}  is  in  an 

e-refinement  of  the  straddle  pair  (a„,  b„)  for  all  n.  We  say  {[fln,  is  the 

accessible  straddle  segment  sequence  if  {a„,  b„}  is  selected  using  the  accessible  basin 
boundary  refinement  procedure  for  all  «.  For  every  s,  0<e^0.5,  each  straddle 
segment  sequence  {[a„,  rinly}/!:.!)  converges  to  a  point  on  the  basin  bouridary.  In 
section  5  we  will  show  that  there  exists  e>0  (depending  on  F  and  R)  such  that  for 
every  accessible  straddle  segment  sequence  ri„]y}„s()  there  is  an  integer  N^O 
such  that  for  every  integer  n^N  the  straddle  segment  [fl„,a„+i]y  is  contained  in 
basin{i4}.  This  number  e  also  appears  in  the  result  stated  below.  The  main  result 
stated  below  implies  that  the  accessible  basin  boundary  refinement  procedure  is 
valid. 

Theorem.  There  exists  £>0  (depending  on  F  and  R)  such  that  every  accessible 
straddle  segment  sequence  converges  to  an  accessible  point  on  the  basin  boundary. 
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5.  Proofs 

,5.1.  Preliminaries 

Let  the  manifold  JW;  the  distance  p  oh  Af,  and  diffeomorphisih;F  be,  as  before.  We 
assume. that  /?  js  a, basin, boundary  transient  region  for  the  diffeomorphism  F,  and 
that  there  are  generalized  attractors  /I  and  B  such  that  each  point  that  eventually 
leaves  R  is  either  in, basin{/l}  or  in  basin{B};  Recall  that  the  noh-wandering  set  £2 
(that  is,  the  set  of  all  points  x  in  M  such  that  for  every  open- neighbourhood  K  of  .r 
there  exists  n.^l  for  which  F"(V')n  V  is  non-empty)  can  uniquely  be  decomposed 
into  a  finite  collection  of  disjoint  closed  invariant  subsets  and  on  each  of  these 
subsets  F  has  a  dense  orbit;  these  maximal  invariant  subsets  of  Q  appearing  in  the 
decom^'osition  afe  called  the  basic  sets  (see  e.g.  [GH)  for  the  definitions, and  several 
prope;  os  of  uniformly  hyperbolic  systems).  From  now  on.^let  F  denote  a  basic  set 
of  F.  From  the  definition  of  Inv(/?)  it  follows  immediately  that  either  Fc  Inv(l?)  or 
Fn'Inv(/?)  is  empty,  ^us,  we  can  decompose  Inv(l?).into  finitely  many  basic  sets. 
Note  that- T n  Inv(Fj  is  empty’  does  not  imply  TflF  is  empty’,  and  Tni?  is 
non-empty’  does  riot  imply  Tfl  Inv(F). is  non-eritpty’. 

Recall  that  for  zeQ  the  stable  manifold  W*(2)  of  z  is  the  set  of  points ac  for 
which  p(F"{z),  F'’(ir))-*0  as  «-»■<»;  and  the  unstable  manifold  W“(2)  of  z.is  the  set 
of  points  X  for  which  p(F"''(z),  F”"(x))->0  as  n-*».  The  local  stable  manifold 
W|oc(z)  of  z  (of  s  e  /3), is  the  set  of  points  x  iri  W^(z)  such  that  p(F'’(z),  F''{x))  jS 
fonail  integers 7J  0^  and  the  local  Unstable  frianifpld  Wroe(2)  of  z  is  the  set  of  points 
X  in  ^“(2)  such  that  p{F~''{z),  F“''(jc))«/3  for  all  n^O,  where  /3>0.  When  the 
stable  or  unstable  manifold  is  a  curve,  we  write  W^(z)  and  W^(z)  for  the  two 
components  of  W|^(2)V{2},  where  a  is  either  s  or  u. 

We  call  F  a  tr/u/a/  basic  set  if  F  consists  of  one  periodic  orbit,  and  we  call  F  a 
non-triviai  basic  set  if  F  includes  more  than  one  periodic  orbit;  Assume  that  F  is 
non-trivial;  wexall  F  periodic  if  there  exists  m  ef^  such  that  F”  has  no  dense  orbit 
on  F.  and  we  call  F  non-periodic  if  it  is  not  periodic. 

We  will,  see  below  that  the  structure  of  Inv(R)  is  essentially  controlled  by  finite 
sets  of  periodic  points.  Recall  that  x  in  Inv(F)  is  accessible  from  an  open  set  V  if 
there  is  a  curve  y  such  that  y\{A:}  lies  in  V.  If  we  choose  V  to  be  the  transient  set 
F\5(F),.and  if  jc  in  Inv(/?)  is  accessible  from  R\S{R)\t  is.always  possible  to  choose 
this  curve  y  to  be  a  piece  of  the  unstable  manifold  W“(ac),  that  is,  y  can  be  chosen  to 
be  either  W“o^(a:)  or  W’“«(x).  Notice  if  x  is  accessible  from  R\S{R)  and 
y  =  W“«(a:),  then  x  is  not  a  limit  point  of  W“oJ(jc)  n  Q.  Similarly,  if  we  choose  V  to 
be  the  open  set  R\U(R),  and  if  x  in  Inv(F)  is  accessible  from  F\f/(R)  it  is  always 
possible  to  choose  this  curve  y  to  be  a  piece  of  the  stable  manifold  W'(;t),  that  is,  y 
cari  be  chosen  to  be  either  VVfJ^(A:)  or  WjM(j:).  Applying  a  result  due  to  Newhouse 
and  Palis  [NP],  we  obtain  the  following. 

Proposition  5. 1.  There  exists  a  finite  set  P  of  periodic  points  in  Inv(F),  F  =  F“  U  P, 
such  that  each  point  in  Inv(i?)  that  is  accessible  from  R\S{R)  is  in  W*(p)  for  some  p 
in  F“,  and  each  point  in  ln\(R)  that  is  accessible  from  R\UiR)  is  in  W“(p)  for 
some  p  in  F. 


Proof.  For  a  proof,  see  Newhouse  and  Palis  [NP].  □ 
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Palis  and.  Takens  [PT]  have  shown  that  there  exist  regions  in  M,  whose 
boundaries  are  segments  in  the  stable  and  unstable  manifolds  of  these  finite  sets  of 
periodic  points  P*  and  P“,  such  that  the  intersection  of  the,  union  of  these  regions 
with  the  saddle  basic  set  F  is  a  Markov  partition  for T,  see  Bowen  [B]  for  the  notion 
of  Markov  partition. 

Proposition.  5.2.  Assume  f.  is  a  non-trivial  non-periodic  basic  set  in  Inv(/?),  and  let 
z  6  r  be  fixed;  Let  P*  and  P“  be  as  above.  T^ere  exist  finitely  many  disjoint  . regions 
P;  being  diffeomorphic  images  of  the  square  B  =  [-1, 1]  x  [-1, 1);  say  P,  =  g,(B), 
1  ^  /V  for  some  N  6  PsJ,  and  a  connected, subset  1“  of  lV“(z)  such  that; 

(11  rn  P;  is  non-empty  for  all  /; 

(2k<=Uf-,P,; 

(3)  P(3,P,)cU/li5,P/  and  P"‘(5,;P,)c:U/i,  5„P,.,  where  d,Ri  = 

=  |y|=sl})  and  d„Ri  =  gi{{{x,  y)\\x\^l,  |>'|  =  1})  are  connected 

subsets  in  the  stable  set  W‘{P“  D  F)  and  the  unstable  set  W“(P  n  F)  respectively;  and 

(4)  'for  every  i,  /“  n  P,-  consists  of  exactly  one  component  and  5(/"nP,')c 
d,Rj,  l^i^N. 

Proof.  For  a  proof,  see  Palis  and  Takens  [PT].  □ 

Recall  that  P  is  a  basin  boundary  transient  region,  and  F  a  basic  set  in  Inv(P). 
From  now  on,  let  the  point  zeF,  the  regions  P,,  l^i'^N,  and  the  segnient 
1“  <zW'*{z)  be  as  in  proposition  5.2.  There  exist  a  C'*",  .stable  foliation  on  a 
neighbourhood  Ff  of  F  and  a  unstable  foliation  SF“  on  a  neighbourhood  Yp  of 
F,  for  some  a>0.  Since  it  is  no  restriction  to  assume  that  every  region  Pj  is 
contained  in  KpH  Vp,  1  N,  see  [PT],  we  will  do  so. 

Let  t:IR-»M'“(z)  be- a  parametrization,  and  define  a  projection  n::F-* 
UjliP,  n/“  by  taking  in  each  region  P,  the  projection  along  the  local  stable 
manifolds  into  the  intersection  /“  with  that  region,  1  ^  ^  M  This  projection  can  be 
extended  from  F  to  the  union  of  the  regions  P,-  by  projecting  along  the  leaves  of  the 
foliation  This  extension  will  also  be  denoted  by  ;r.  The  following  result  says  that 
for  some  iterate  K,  the  map  F  can  be  viewed  as  expansive  along  unstable  segments. 

Proposition  5.3.  There  exist  a  positive  integer  K  and  a  C'*“  map  <iP:Un.i  n 
P,)-»  R  defined  by  q){x)  =  °  n  °  F'^  °  t(j:)  such  that  |g5'(A;)|  >  1,  for  some  a  >  6. 

Proof.  For  a  proof,  see  Palis  and  Takens  [PT].  □ 


5.2.  Proof  of  the.  theorem 

Let  /  c  C/(P)  denote  an  unstable  segment.  Recall  that  both  end  points  of  J  are  on 
the  boundary  of  the  basin  boundary  transient  region  P,  and  that  J  intersects  the 
stable  set  S(R).  Recall  also  that  if  a  point  x  in  P  eventually  leaves  P,  then  x  is  either 
in  basin{A}  or  in  basin{B}. 

We  define  for  every  integer  k^l: 

C, (J)  =  {xeJ:Ux)^k} 

D, (J)  =  {xeJ:Mx)  =  k}. 
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In  particular,  Ci(7)  =  /.  Hence,  for  each  integer  k^  \  we  have  C*^i(/)  is  the  set 
of  pointSt,in;C*(;/)  whose  escape  time  from  /fMs  at.least  k  +  1;  hence,-C'*+i(y)'is  the 
set  of  points  in  J  thai  stay  jn:f?  under  f*.  The  points  in  7  which  stay  in  R  under  all 
iterates  will  be  denoted  by  C<»(y).  For  every  /cs*  !,  we  write 

b,i{J;A)  =  {x  6  bk{J)  \x  e  basin{/4}} 

5)  =  (a;  6  Z)*(7) \x  e  basin{fl}}. 

The  ‘basin  boundary  property’ now  implies  that  for  every  ks:  1: 

D,(J)  =  D,(J;A)UD,(J;B). 

Notice  that  basin  {/I}  and  basing!?}  are  disjoint  open  sets,  so  that  if  there  are 
points  aeynbasin{/l}  and  b  eyobasinjfl},  then  there  is  a  point  x  in  [a,  b]j  with 
Tr{x)  =  ’^.  Observe  that  Q  is  a  component  oi  DkiJ)  if  and  only  if  Q  is  a  component 
of  either  Dk{J\A)  or  D^{J\ B), 

For  each  k  >  I  we  have: 

c*(y)  =  Cfc^,(y)  u  D*(y)  =  c*^,(y)  u  D*(y;  a)u  d,{j\  b) 

J = /  0  u  U  Di(:J)  =  c*^,(y)  u  u  A(y ;  /\)  u  u  D;(y ;  b) 

/-I  /-»  y-1 

that  is,  y  is  the  union  of  the  set  of  points  C*+.|(y)  whose  escape  time  from  R As  at 
least  k  1  and,  the  set  of  points  D/y)  whose  escape  time  from  R  \s  j,  and  each. of 
those  pv  is  is  either  in  basin{/I}  or  in  basin{B},  where  1 We  write 

DM)  =  U  DM)  =  U  DMl  A)U\J  DM\  B). 

*«i  *«i  *«i 

Note  tb-  CM)  =  Dfc-o  CM)>  and  J  =  CM)  U  D^y). 

Let  c  0  a  component  of  CM)  ^hat  includes  a  point  of  basin{/I}  (or  basinjU}). 
The  following  result  then  says  that  for  some  fixed  positive  integer (depending  only 
on  F  and  R),  C  contains  a  component  of  Dt+,(y;/I)  (or  UJ=(1  Di,+,{J-,  B)).  In 
particular,  s  does  not  depend  on  k.  The  following  lemma  (basin  boundary 
combinatorial  lemma)  is  used  to  prove  the  ‘basin  boundary  geometric  lemma’  which 
follows. 

Basin  boundary  combinatorial  lemma.  Let  X  denote  either  A  or  B,  There  exists  an 
integer  s  3=  1  such  that  for  every  unstable  segment  J  and  for  each  integer  k  &  I  and 
every  component  C  of  Cfc(y),  the  following  holds. 

If  C  includes  a  point  of  basin(Ar},  then  there  is  an  integer  /,  k^i<k+s  and  a 
component  D  of  D,{J',  X)  such  that  DczC. 

Proof.  Let  U  be  a  neighhf'urhood  of  Inv(/?)  on  which  a  C''’’’*  stable  foliation  3^ 
exists,  for  some  a'>0.  Select  the  minimal  integer  1  such  that  for  each  basic  set  F 
of  F'’  the  following  holds,  either  F  is  a  fixed  point  or  F  is  a  non-triviai  noh-periodic 
basic  set.  For  each  non-periodic  basic  set  F  of  F'',  let  /p  and  the  regions  F;(F), 
1 « / «  ^(F,  be  as  in  proposition  5.2,  and  let  f/p  be  an  open  neighbourhood  of  F 
such  that  (1)  U?LT^F,(F)  c  t/pc  t/,  (2)  the  set  Tr‘(/pn  l/p)  consists  of  iV(F)  open 
intervals  and  its  closure  consists  of  N(F)  disjoint  intervals,  and  (3)  the  map  gjp  in 
proposition  5.3  may  be  extended  to  TF'(/rn  t/p).  For  each  trivial  basic  set  F,  let  (Ji¬ 
be  an  open  neighbourhood  of  F  in  1/  such  that  f/p  does  not  intersect  I/a,  for  each 
basic  set  A  in  Inv(/?)\F. 
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Let,  L\, — ,  Llur)  be  the  components  of  Tp'(/f  n  f/p);  these  finitely  many 
components  are  open  intervals  in  R.  Select  the  minimal  integer  ^(r)>  1  stich  that 
the  map  q>r:rr\lrC\Ur)-*U  defined  by  (pr(^)  =  °  °  satisfies 

|(Pr(j:)l  >  1,  Define  the  map  tpr'.  Tp'(/f  D  fyr)-»R  by  tprix)  =  tf ' » ;r  »  F''  °  Tr(x). 
Now  we  define  the  /V(r)  x  N{r)  matrix  /Ip  by 


if  ipriLf)  3  Lf 
otherwise 


for  all  1  i,  j  ^  A/(r).  Since  r  is  a  non-trivial  non-periodic  basic  set  of.F'',  the  matrix 
/ip  is  primitive.  Choose  the  minimal  integer  m(r)  ^  1  such  that  all  the  entries  of  the 
matrix  /fp"’’  are  positive. 

We  define  the  integer  s(r)  as  follows.  If  P  is  a  non-trivial  non-periodic  basic  set. 
then  define  s(r)  =  m(r)  •  v,  and  if  P  is  a  fixed  point  of  F''  define  s(P)  =  v.  Now,  let  s 
be  the  smallest  common  multiple  of  {5(P);P  is  a  basic  set  of  F''). 

Let  w(/?)  be  the  number  of  basic  sets  of  F''  in  Inv(/?),  and  write  Inv(/?)  = 
U*i?*r*.  We  associate  with  Inv(F)  a  directed  graph  Gy  as  follows;  Gy  consists  of 
the  points  P*,  \  ^k^m{R),  and  there  exist  a  path  from  P,  to  P,  if  there  exists  a 
point  z  e  Pf  such  that  W“(z)  n  W'(r,)  is  non-empty.  Notice  that  for  each  k, 
1 «  k^m{R)  there  exists  a  path  in  Gy  from  P*  to  itself. 

Let  J  be  an  arbitrarily  chosen  unstable  segment.  Select  an  integer  |  ^  I  such  that 
QG)  istcoritained  in  U.  Let  /V  denote  the  number  of  components  of  €{(7),  that  is, 
QG)  =  Urli  G{.,(y).  From  the  definition  of  the  matrices  associated  with  the 
non-trivial  basic  sets,  the  directed  graph  Gy  associated iwith  Inv(F),and  the  choice  of 
the  integer  s,  and  using  the  techniques  in  [Nul]  and  [Nu2],  we  can  associate  a 
(0,  l)-matrix  Mj  with  C|(7),  which  is  defined  by 

fl  if;r,oF''(C,„G))=>C5.,(y) 

lo  otherwise 


for  all  1  ^  I,  /,  where  Jtj  is  the  projection  on  J  along  the  stable  leaves. 

We  will  assume  that  the  C^-jS  are  numbered  in  such. a. way  that  the  matrix  Mj  is 
written  in  the  normal  form,  that  is. 


rM„ 

Afai 


Mm\ 


0 . 0  * 


where  each  M**  is  an  N*  x  matrix  which  is  either  irreducible  (that  is,  for  each 
pair  (/,  j)  there  exists  t  e  IM  such  that  the  (i,  /)th  entry  of  the  matrix  (Af**)'  is  positive, 
l^j,  j^Nk)  or  a  1  X  1  null  matrix,  l^k^m  and  E*_i A/*  =  N  for  some  m, 
This  assumption  on  the  is  no  restriction,  since  for  every 

non-negative  square  matrix  B  there  is  a  permutation  matrix  P  such  that  PBP^  has 
the  normal  form  (see  Berman  and  Plemmons  [BP]).  In  particular,  each  irreducible 
Mkk  is  primitive,  and  if  iVjt  ^2  then  A/**  equals  /tp  for  some  non-trivial  nonperiodic 
basic  set  P  in  ln\(R),  and  from  the  choice  of  the  integer  s  it  follows  that  all  the 
entries  of  {MkkY  are  positive. 

Let  X  denote  either  A  or  B.  Let  integer  A;  ^  1  be  given.  Let  C  be  any  component 
CjciJ),  and  assume  that  C  includes  a  point  of  basinfAT}.  We  first  assume-that  /c  5=  |. 
The  definition  of  Mj,  the  choice  of  s,  and  the  results  in  [Nul]  and  [Nu2]  yields  that 
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there  exists  an  integer  /,  k^i<k+s  :\nd  a  component  D  of  Di(J;X)  such  that 
Dcz  C,  This  result  together  with  the  .efinitions  of  Ak(J)  and  D,(7;A')  imjjly 
immediately  that  also  for  one  has  that  C  includes  a  component  of 

Di{JjX)jon some  /,  k^i<k+  Si 

Since  J  was  arbitrarily  given;  we  have  shown  the  following;  There  exists  an 
integer  s'^\  such  that  for  every  unstable  segment  7  and,  for.  each  integer  ^  5=  1  and 
eyery  component  C  of  C*(y),  the  following  holds.  If  C  includes  a  point  of  basinlAf}, 
then  there  is  an  integer  i,  k^i<k+s ‘and  a  comporieht  D  of  D;(7;A’)  such  that 
bczC,  where  X  denotes  cither  A  ot  B.  This  completes  the  proof  of  the  basin 
boundary  combinatorial  lemma.  □ 

From^  now  on.  let  j  be  as  in  the  ‘basin  boundary  combinatorial  lemma’,  and  let 
G  =  F\  We  now  consider  the  escape  time  of  points  under  G.  For  every  point  x  in  R, 
the  escape  time  Tr{x)  of  a:  under  G  is  defined  by  7r(a:)  =  min{rt  ^M:G''(x)  $  R) 
and  Tk{x)  =  »  if  G''(a:)  e  R  for  all  n  ^  1.  We  say  that  T«(.t)  =  0  if  x  ?  R. 

We  define  for  every  integer  k^l'. 

CW)={xeJ-,T^{x)^k} 

Dk{J\A)  =  {x  eJ'.TKix)-  k  and  jc  e  basin{/l}} 

Dk{J\B)  =  {xeJ.\T^{x)  =  k  and jc ebasih{fl}}. 

Hence,  for  each  integer  /c&  l  we  have  C*+|(7)  is  the  set  of  points  in  Cf(7) 
whose  escape  time  under  G  from  R  is  at  least  /:+  1;  hence,  C*^+i(7)  is  the  set  of 
points  in  J  that  stay  in  R  under  C*.  The  points  in  J  which  will  stay  in  R  under  all 
iterates  will  be  denoted  by  C%J).  For  each  it  2=  1  we  have: 

C^k{J)  =  U  D<^{J-,A)  U  D?{7;  B) 

J  =  Civ, (7)  U  u  D/'{7;  A)  U  B) 

;»l  /=| 

that  is,  7  is  the  union  of  the  set  of  points  Ci+,(7)  whose  escape  time  under  G  from  R 
is  at  least  k  +  1  and,  the  set  of  points  Dy(7;/I)  in  basin{/I}  (respectively,  0^(7;  B) 
in  basin{fl})  whose  escape  time  under  G  from  R  is y',. where  l^j^k.  We  write 

D2(J)  =  0  Di’iJ;  A)  U  U  B) 

Note  that  C?(7)  =  n*=o  Ci'(7).  and  7  =  C^(7)  U  D?(7)- 

Lemma  5.4.  For  every  integer  k^  I,  we  have: 

(1)  =  /)f(7;  fi)  =  A(/;  B): 

(2)  C^(7)  =  C.(7)  and  D^(7)  =  0.(7); 

(3)  each  component  of  0^(7)  belongs  to  either  basin  {/I }  or  basin{fl}. 

Proof.  The  proof  is  left  to  the  reader.  □ 

Note  that  the  set  D2(J)  is  the  set  of  points  xeJ  with  finite  escape  time  (that  is, 
T nix)  <'■”).  The  following  result  says  that,  if  the  value  of  the  escape  time  map  Tr 
changes  then  it  changes  in  steps  of  1.  Denote  the  length  of  a  connected  subset  LaJ 
by  p(L). 
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T-junip  property.  For  eveiy'X#/  with  7’r(a:)<  «?,  there  exists  £>()  such  that  each 
y  eJ  with.p([;c,,y]>) <e  satisfies4=7}«(^)  -  7:R(^)|;=el. 

Prod/.  Apply  lemina'5;4  and  the  T-jiimp.lemma  in  [NY2];  [3  ' 

The  following;  lemma  for  G  implies  that  if  an  unstable  segment  y  has  a 
component  C  of  C*(y).  that  intersects  basin{A:},  then  there  is  a  point  p  of 
Cf(y)hbasin{Ar}  with  escape' time  k,  and  the  length  of  the  component  D  of 
D*(y;  AT)  including  p  is  at  least  6  •  p(C). 

Basiii  boundary  geometric  lemma.  Let  AT  denote  either  A  or  B.  There  exists  6>0, 
such  that  for  every  unstable  segment  J,  and  for  each  integer  k'^l  and  every 
component  C  of  we  have: 

IfC  includes  a  point  of  basin{Ar},,.then  there  is  a  component  D  of  A').such 
that  D  c  C  arid  p{D)lp(C)  ^6. 

Proof.  From  the  geometric  lemma'll  in  [NY2]  applied  to  G,  there  exists  6 >6  such 
that  for  every  J  in  and  for  every  integer  1,  the  following  holds: 

(1)  each  component  of  C*  (/)  contains  components  of  C*  (7)  ana  C?+,(y);:and 

(2)  if  C  is  any  component  of  Cf(7),  then  every  component  D  of  D*(7)nC 
satisfies  p(D)lp{C)^d,  and  every  component  U  of  C*V,(7)nC  satisfies 
p{U)lpiC)^6. 

Let  X  denote  either  A  or  B,  and  let  J  be  any  unstable  segment.  Let  integer  k^X 
and  component  C  of  C*(7)'be  given.  Assume  thafC  includes-a  point  of  basin{Ar}. 

Applying  the  basin  boundary  combinatorial  lemma  yields  that  there  exists  a 
component  D  of  D*(y;  Y)  such  that  D  cC.  From  the  geometric  lemma  II  in  [NY2], 
since  O  is  a  component  of  D^iJ),  and  the  definition  of  6,  we  obtain  p{D)lp{C)  ^ 
6.  Since  J,  k  and  C  are  assumed  to  be  given  arbitrarily,  we  conclude  for  each 
unstable  segment  J,  for  each  integer  k  ^  1  and  every  component  C  of  C*  (7),  if  C 
includes  a  point  of  basin  {Y},  then  there  is  a  component  D  of  Dk{J',X)  such  that 
DeC  and  p{D)lp(C)^d.  This  completes  the  proof  of  the  basin  boundary 
geometric  lemma.  □ 

From  now  on,  we  fix  d  as  in  the  basin  boundary  geometric  leriima.  Before  we 
prove  the  theorem,  we  present  a  non-intertwining  property  for  the  escape  time  map 
as  well  as  an  auxiliary  observability  result  for  accessible  straddle  pair  sequences.  We 
call  a  pair  {p,  q)  a  balanced  pair  if  T^{p)  =  T^iq). 

Non-intertwining  lemma.  Let  {/?,  be  a  balanced  pair,  let  P  be  a  5^-refinement  of 
(p,  q},  and  assume  that  ^  Tr{p)  for  every  jc,-  in  P.  If  each  point  of  P  is  in 
basin{A}  then  [p,  q\j  is  contained  in  basin{A}. 

Proof.  Let  {p,q}  and  P  be  as  in  the  lemma.  Assume  that. each  point  of  P  is  in 
basin{A}.  Write  m  =  min{rR(jc)  :x  e  [p,  q\j).  The  assumptions  'TrIxi)  ^  Tfi(p)  for 
all  Xi  e  F,  ‘P  is  a  d^-refinement  of  {p,  together  with  basin  boundary  geometric 
lemma  yields  that  m  =  TrCp).  Hence,  [p,  q]j  is  contained  in  a  component  of  C°(y). 
If  there  exists  a  component  D  of  D°(y)  including  [p,  q]],  then  D  is  a  component  of 
7)^(7;  A),  and  we  are  done.  Therefore,  from  now  on,  we  assume  that  [p,  q\j  is  not 
contained  in  a  component  of  0^(7).  This  implies  that  there  are  at  .'east  one 
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component  of  C^+i(7)  in  the  interior  of  [p,  and  at  least  two  conip6nents:6f 
D°(j)  which  have  a  non-empty  intersection .with  [p,  q\j. 

Let  D  be  a  component  pf.fZ)m(y)  such  that  D  njp,  is  nonrempty.  By  the  basin 
boundary  geometric  lemma,,  we  have'  p{D)lp{[p,  q]j)>  d.  Since  P  is  ah  e- 
refinemeht  of  {p,q},  it  follows  that  PfiD  is  non-empty.  This  fact  and  the 
assumption  thaV each,' point  of  P  is  in  basiri{>i}  imply  that  D  is  a  component  of 
0^(7;  .;4).  This  implies  that  [p,  h  D, ^(7)  is  contained  in  basin{/4}. 

Let  Cbe  any  component  of  C^+,(7)  in  the  interior  or  [p,  q]j.  Applying  the  basin 
boundary  geometric  lemma  we  get  th&t  p{C)/p([p,.q]j)  >  6.  If  C  includes  a  point  of 
basin{B},  then  G  includes  a  component  D  of  Z)^+,(7:  B),  and  by  the  barin 
boundary  geometric  lemma,  we  have 

p(D)/p((p  )  =  (p(D)/p(C)) .  (p(G)/p([p.  q]j))  >  6-. 

Hence,  if  Cincludes  a  point  of  basin{B}  then  every  b’-refinement  of  (p,  p}  inriudes 
a  point  of  basih{B}.  Since  P  is  an  ^’-refinement  of  {p,  q)  and.P  does  not  contain;a 
point  of  basin{fl},  it  follows  that  C  includes  no  point  of  hasin(B}.  Since  C'is 
arbitrary,  we  get  that  each  component  of  CS+,(7)  that  is  in  [p,  q]j  contains  no 
point  of  basin(B}i  Therefore  [p,  q]j  n  C^+|(7)  is  contained  in  basin  {A}. 

Because  of  [p,  p];  =  ((p,  pb  nD^(7)}  U  {(p,  p]yh  Cm+|(7)}  the  coni..asion  is 
that  (p,  pj;  is  contained  in  basin{A}i  This  completes  the  proof  of  the  non¬ 
intertwining  lemma.  □ 

Basin  boundary  observability  lemma.  L  .  dV3-refinemeht  of  a  straddle  pair 

{(to,  bo),  and  assume  T^ixi)  ^  T^{ao)  for  e^cry  Xj  in  P.  Let  {<»(},  bj}  be  the  straddle 
pair  in  P,  in  which  bj  is  selected  as  in  the  accessible  basin  boundary  refinement 
procedure.  Let  a,  be  defined  as  in  the  improved  version  of  the  accessible  basin 
boundary  refinement  procedure.  If  P  is  a  6-refinemcnt  of  {a„,  b]},  then  [flo.  ^1)/  is 
in  basin{A},  and  Vil(al)  =  T°(a„)  +  1. 

Proof.  Let  P,  (ao,  bi},  and  a*  be  as  in  the  lemma,  and  assume  that  Pn[aoi.b,)/  is 
an  f-refinement  of  {ao,  b,},  where  e  =  6^.  Let  m  =  min{TK{x):x  e  (ao,  bijy}.  Let  a',' 
and  a^  be  defined  as  in  the  improved  version  of  the  accessible  basin  boundary 
refinement  procedure. 

The  assumptions  'T^ixi)  &  ^^(ao)  for  all  x,  6  P\  ‘P  n  [a„,  b,b  is  an  e-refinement 
of  {ao,  bi}’,  together  with  the  basin  boundary  geometric  lemma  yields  m  =  Tfi(ao). 
Hence,  [ao,  bib  contained  in  a  component  of  C^(7). 

By  definition,  we  have  ao^a”.  We  show  first  that  [a?,  ajb  is  contained  in 
basin(A}.  Applying  the  T-jump  property  and  the  basin  boundary  geometric  lemma 
we  obtain  that  there  exists  a  component  D  of  Cm+i(7;A)  such  that  D  is  in  the 
interior  of  [a?,  bib,  p(D)/p([ao,  bib)>  6.  Therefore,  a*  exists  and  7^10*)  = 
m  +  1.  The  definition  of  af  and  lemma  5.4  imply  that  [a'l',  a^b  's  contained  in 
basin{A).  Recall  that  (af,  a}}  is  a  balanced  pair,  that  is,  TR(a\)  =  TK(,af).  If  af 
and  a}  are  in  the  same  component  of  D°+i(7)  then  [af ,  a’b  is  in  basinjA},  and  we 
get  that  (a°,  alb  ‘s  in  basin{A}.  Now  assume  that  af  and  a}  are  in  different 
components  of  Then,  [ai",  a{b  includes  at  least  one  component  C  of 

Cm+2(7)  in  its  interior,  and  by  the  basin  boundary  geometric  lemma  we  have 
p(C)lpi[at,  alb)  >  This  implies  that  P  H  [a*,  alb  is  a  6^-refinement  of  (at,  al). 
Applying  the  non-intertwining  lemma  yields  [ai",  alb  is  basin{A},  and  we  obtain 
also  ■“  this  case  that  [a?,  alb  is  contained  in  basin{A}.  We  conclude:  basin{A} 
inclt  fa?,  alb,  and  r^(al)  =  r^(ao)  +  1. 
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If  oo  -  a?,,  then  it  follows  immediately/from’  the. conclusion  above. that:[aqi  dlj,  is 
contained  in  basin{/l}..  From  now; oh,  we  assume  ao<di:  Recail  that  {do,  fl?}.is  a 
balanced  pair; if  Oq  and  a”  are  in  the  same  component  of  then'[ao,  a?jy  is  in, 
basin{4}.  if  ao  and  a?  are  in  different* components  of  then  [do;  a?);  includes 
at  feast  one  component  C  of  CS+i(/).  Since  p([oo.'«”l/)/p([«o.  &i)y)  > 
p(C')/p((ao,  a?]y)>  6'-and  P  n  [ao,  is  a  6Vefinement  of  {ao,  a"},  applying  ;the 
hon-intertwining,  lemma  we  obtain  [ao,.a‘i]y  is  in  basih{i4}.,  Since  [a?,  a}]/ is  in 
basin(i4},  thC’ conclusion  is  that  [ao,  a\]j  is  contained  in  basin {,4}.  This  completes 
the  proof  of  ;fhe  basin  boundary  observability  lemma;  □ 

Proof  of  the  theorem.  Let  6  be  as  in  the  basin  boundary  geometric  lemma,  and 
choose  f -d'’.  Let  {(a„,  f)„]y}„;.i):be  an  accessible  straddle  segment  sequence,  that 
is,  (ao,  6,)}  is  a  straddle  pair  and  {a„,  is  obtained  by  the  improved  version  of  the 
accessible  basin  boundary  refinement  procedure  for  all  n  5=  1.  For  n  5=0,  let  P„  be  an 
e/3-refinement  of  ,(a„,  b„),  and  let  m„  be  as  in  the  improved  version  of  the 
accessible  basin  boundary  refinement  procedure.  By  the  basin  boundary  geometric 
lemma  we  obtain  m„  =  min{7’«(A:):jc  e  [a„, 

We  will  show  that  there  exists  andhteger  N>  0  such  that  for  every  integer  n'^N 
the  following, properties  bold.  {P\)T%a„)  =  m„,  (P2)  and 

(P3)  [d„,  d>,+,l/.  is  contained  in  basin{A}.  Notice  that  we  do  not  claim  that 
ITnix)  -  rfl(a„)|  1  for  all  x  e  (fl„,  where  n^N. 

From  the  7-jump  property  and  the  basin  boundary  . geometric  lemma,  together 
with  the  assumption  that  {(a„,  b„]j)„i,\  is  obtained,  using  the  accessible  basin 
boundary  procedure,  we  have  that  if  TR(fl„)>m„  then  7«(a„+,)  =  w„,  for  each 
« 5=  0.  this  property  implies  that  there  exists  a  minimal  integer  N^O  such  that 
Tn(x/)  >  Wa,  =  T$(aN)  for  each  Xj  e  P^.  Hence,  (PI)  holds  for  N,  We  now  show  that 
(P2)  and  (P3)  hold  for  this  integer  N. 

Case  1.  Pff  is  not  an  e-refinement  of  (a^,  Then  a,v+i  =fl^,  so  («^,  «/v+ijy  is 
contained  in  basin(A}  and  =  7«(a;v+i)  for  each  .r,  e  /{v+i-  Therefore, 

(P3)  holds,  while  (P2)  is  obvious  since  =  3^+,. 

Case  2.  Pfj  is  an  e-refinement  of  {a^,  bN+i).  The  basin  boundary  observability 
lemma  Implies  (P3)  since  [as,  a^v+i]/  is  contained  in  basin  {/t}.  It  also  implies  (P2) 
since  7jj'(A:,)  ^  +  I  for  each  Xi  e  7^,+,. 

By  induction,  one  obtains  the  desired  result.  This  completes  the  proof  of  the 
theorem. 


6.  The  numerical  procedure  and  related  numerical  methods 

6.  i.  The  dynamic  problem 

Now  we  return  to  the  ‘dynamic’  problem  stated  in  the  introduction,  namely,  to 
describe  a  procedure  for  finding  a  numerical  trajectory  on  the  basin  boundary  which 
is  accessible  from  basin{i4}.  (Recall  that  the  basin  boundary  of  basin{/l}  is  the 
boundary  of  the  closure  of  basin{A}.)  We  assume  we  are  given  a  straight  line 
segment  that  intersects  the  basin  boundary  transversally  and  has  one  end  point  in 
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basin{/l}  and  the  other  end  point  in  basin{i5}.  In  the  statement  of  the  results,  we 
assume  that  a  straddle  pair  and:  its  £-refihement  lie  in  a  connected  subset  of  an 
unstable  segment,  and  that  ail  unstable  segments  intersect  the  basin  boundary 
transversally.  However,  from  our  proof  of  the  theorem  it  follows  that  a  similar  result 
holds  if  we  replace  the  unstable  segment  by  a  straight  line  segment  so  that  we 
assume  that  every  e-refinement  of  a  straddle  pair  {a,  b}  is  in  the  straight  line 
segment  [a,  b]  from  a  to  b,  and  that  [a,  b]  intersects  the  basin  boundary 
transversally. 

A  straight  line  segment  (a,  b]  straddles  the  stable  manifold  of  a  point  P  if  [a,  b] 
intersects  this  manifold  transversally.  In  the  cases  we  study,  that  is.  A6basih{A} 
and  f?6basin{B},  the  stable  manifold  of  P  will  be  replaced  by  a  (fractal)  basin 
boundary  and  (a,  b]  will  straddle  a  subset  of  the  basin  boundary.  Furthermore,  in 
practice  (a,  f))  will  be  very  short  and  will  be  extremely  close  to  the  invariant  set 
lnv(/?). 

The  numerical  procedure  goes  as  follows.  , 

(1)  Choose  (with  some  experimenting)  a  straddle  pair  (a,  b)  and  let  /  denote  the 
line  segment  from  a  to  b, 

(2)  Apply  the  accessible  basin  boundary  refine’^ent  procedure  (that  is,  refine 
and  choose  a  new  straddle  pair  (a:,  y}  in  /  and  then  replace  /  by  the  straight  line 
segment  from  x  to  y.  Repeat  this  process  until  the  length  of  /  is  less  than  some 
distance  a  (for  example,  a  -  10"").  If  the  initial  a  and  b  are  less  than  a  apart,  then 
the  pair  is  not  changed, 

Given  any  initial  straddle  pair  (a,  b),  we  will  write  {uo,  bn)  -  ABS„({a,  b)),  for 
the  straddle  pair  resulting  from  step  2.  Note  that  I1ao-6o11<o.  ‘ABS’  is  an 
abbreviation  of  ‘accessible  basin  boundary  straddle  refinement*. 

(3)  For  each  integer  n^O,  and  straddle  pair  {a„,  b„}  such  that  |lA„  -^f)„||  <a, 
compute  the  refinement  for  the  image  pair  {F{a„),  F{b„)},  and  write 

{a„+i,  b„^i)  =  ABS„(/='(a„),  F{b„)}. 

Thus  we  obtain  a  sequence  {{a„,  b„}}„^o  of  straddle  pairs.  Note  that  only  F(a„)  and 
F(b„)  and  a  are  relevant  to  the  computation  of  {a„+„  = 

ABSo({F(a„),  F(b„)}),  since  ABSo({F(a„),  F{b„)})  is  a  straddle  pair  in  the  line 
segment  from  F(a„)  to  F{b„). 

Write  /„  for  the  line  segment  from  a„  to  b„.  Since  the  system  is  hyperbolic  and 
the  matrix  of  the  second  partir'  'erivatives  D^fwill  be  bounded  on  the  closure  of 
the  region  R,  there  will  be  a  bi,  -id  on  the  curvature  of  the  curve  F{I„),  and  F(/„) 
will  deviate  from  the  straight  line  segment  L„  from  F{A„)  to  F{b„)  by  an  amount 
proportional  to  \L„f,  where  \L„\  denotes  the  length  of  L„. 

We  thus  obtain  a  trajectory  of  tiny  straight  line  segments  I„  and  to  the  precision 
of  the  computer  (about  lO"’"*)  we  usually  have  /„+,cF(/„),  and  selecting  any  point 
x„  from  I„,  perhaps  the  midpoint,  we  have  that  lx„+i  -  Fix„)\  is  small,  typically  of 
the  order  of  a.  Since  computers  can  never  be  expected  to  produce  true  trajectories 
(except  in  trivial  cases  such  as  fixed  points),  we  may  say  {.x„}„ao  is  a  numerical 
trajectory  with  precision  a.  Despite  the  complexity  of  the  construction,  we  will  refer 
to  Xn+i  as  the  ‘iterate’  of  j:„.  We  call  the  sequence  of  intervals  an  accessible 

basin  boundary  straddle  trajectory  or  ABST  trajectory,  and  we  call  the  numerical 
procedure  above  that  generates  the  sequence  {/„}„>o>  the  accessible  basin  boundary 
straddle  method  or  ABST  method.  Notice  that  each  interval  straddles  a  piece  of  the 
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basin  boundary.  After  ai  few  iterates,  the  sequence  resembles  a  subset  of  the 

non-wandering  points  \nR  which  are  accessible  from  basin  (A). 

In  this  paper  we  have  shown  that  pur  procedure,  (the  accessible  basin  boundary 
refinement  procedure)  is  valid  in  ideal  situations.  We  find  that  the  accessible  basin 
boundary  straddle,  method  works  well  in  practice  even  in  less  than  ideal  cases,  in 
particular  cases  where  hyperbolicity  seems  to  fail.  If  e  is  chosen  too  large,  then 
{{On>bn))n>»  would  Still  bc  a  sequence  of  straddle  pairs  with  o„ebasin{A}  and 
b„ebasin{fl},  but  the  sequence  would  not  be  accessible  and  probably  would  riot 
settle  down  to  a  periodic  orbit. 

In  practice  we  find  that,  in  most  cases  we  study,  the  method  appears  to  work  well 
for  £  =  1/30.  In  computing  the  sequence  of  straddle  pairs  (a„,  b„}  defined  by  the 
accessible  basin  boundary  refinement  procedure,  once  case  (2c)  holds,  then  it  can  be 
shown  that  every  £-refinement  of  the  proper  straddle  pair  [a,  b)  includes  a  proper 
straddle  pair.  For  the  examples  in  this  paper  we  find  that  the  accessible  basin 
bouridary  straddle  method  leads  (in  all  cases  but  one)  to  accessible  fixed  points  or 
periodic  points,  in  agreement  with  the  fact  that  all  the  accessible  poirits  for 
two-dimensional  saddle-hyperbolic  systems  are  on  the  stable  manifolds  of  finitely 
man*'  periodic  points.  The  e  xeptional  case  is  the  example  of  the  complex  quadratic 
map  of  which  the  basin  boundary  is  two-dimensionally  unstable,  and  the  result  due 
to  Newhouse  and  Palis  does  not  apply  in  this  particular  case. 


6,2.  The  accessible  set  on  the  basin  boundary 

We  have  seen  above  that  in  many  interesting  cases  our  numerical  method  (accessible 
basin  boundary  straddle  method)  produces  a  periodic  trajectory  on  the  basin 
boundary  that  is  in  Inv(/?).  If  P  is  a  periodic  trajectory  in  Inv(/?)  that  is  accessible 
from  basin(A),  then  all  the  points  op  the  stable  manifold  of  P  are  accessible  from 
basin(A}.  Therefore,  we  need  a  numerical  method  that  produces  the  stable 
manifold  of  a  periodic  point.  In  [YKY\  a  procedure  has  been  presented  that  can  be 
used  for  the  calculation  of  stable  manifolds  of  saddle  periodic  points  of  the 
diffeomorphism  F.  The  calculation  can  be  made  with  a  guaranteed  accuracy,  in 
particular,  it  can  be  used  to  calculate  the  pieces  of  the  stable  manifolds  of  the 
periodic  points  that  we  find.  As  illustration,  we  present  in  figure  9  the  stable 


Figure  9.  The  stable  manifold  of  the  fixed  point  of  the 
Hfinon  map  (with  p  =  1.405,  p  =  -0.3)  that  is  accessible 
from  basin{B}. 
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manifold;  of  the  period*  1  saddle  in  the  example  of  the  Hdnon  map  for  which  the 
attractor  infinity  (attractor  /i)  and  a  period  2  attractor  coexist.  Tliis  stable  manifold 
of  the  saddle  fixed  point  constitute  the  accessible  set  (accessible  from  basin{/l} '  on 
the  barin  boundary. 


6.3.  Related  straddle  trajectories 

In  this  subsection  we  review  briefly  ‘straddle  trajectories’  that  are  obtained  by 
methods  which  are  based  on  refinement  procedures  such  as  the  bisection  procedure 
(BGOYY),  (GNOY),  the  PIM  triple  refinement  procedure  [NYl],  [NY2)  and  the 
accessible  PIM  triple  refinement  procedure  [NY2).  The  methods  were  used  in  the 
applications  presented  in  section  3  and  the  refinement  procedures  above  are  related 
to  the  accessible  basin  boundary  refinement  procedure.  These  straddle  methods  are 
numerical  niethods  for  obtaining  trajectories  on  the  basin  boundary  and  on  chaotic 
saddles.  For  clarity  of  the  exposition  and  in  order  that  this  paper-is  self-contained, 
we  describe  these  methods;  see  the  references  above  for  details. 

Straddle  methods  involve  a  refinement  procedure  in  which  2  points  on  a  curve 
segment  are  replaced  by  two  new  points.  In  some  cases  the  points  have  different 
roles.  Usually  each  of  the  refinement  procedures  takes  a  pair  of  points  and  returns  a 
pair  of  points;  such  a  returned  pair  is  on  the  line  segment  joining  the  two  points  of 
the  original  pair.  Thu  distance  between  the  two  points  in  the  returned  pair  is  smaller 
than  the  distance  between  the  points  of  the  original  pair.  Straddle  methods  consist 
of  applying  the  refinement  procedure  repeatedly  until  the  points  in  the  resulting  pair 
are  less  than  some  specified  distance  a  apart,  say  o  =  io~^  If  the  points  in  the 
original  pair  are  already  less  than  a  apart,  then  no  refinement  is  carried  out.  Next 
apply  the  dynamics;  that  is,  apply  the  map  F  to  each  of  the  two  points  of  the 
resulting  pair,  giving  w  pair. 

The  basic  numericu.  method  takes  a  pair  {a„,  b„}  which  is  separated  by  at  most  a 
distance  a.  and  applies  the  map  F  to  each  of  the  points  of  this  pair.  If  the  new  pair 
{f(fl„),  F{b„)}  is  separated  by  less  than  a,  then  it  is  denoted  b„+i},  and 
otherwise  the  refineme  'ocedure  is  applied  repeatedly  until  a  pair  with  septaration 
at  most  .a  is  obtained,  uiiu  it  is  called  {a„+i,  b„.n}.  However,  ii.  der  to  produce 
the  first  pair  (ao,  bo),  the  method  starts  by  applying  the  refinement  procedure  on 
the  given  pair  (a,  b),  whose  points  are  presumably  more  than  a  apart.  Writing  1„  or 
[a„,  b„\  for  the  line  segment  from  a„  to  6„,  and  to  the  precision  of  the  computer  we 
usually  have  /„+,  c  f  (/„).  We  call  the  sequence  of  tiny  straight  line  segments  {4i}„ao 
a  straddle  trajectory. 

BST  method.  The  ‘basin  boundary  dynamic  problem’  is  to  d“  'e  a  numerical 
method  for  finding  a  trajectory  on  the  basin  boundary. 

the  refinement  procedure  for  straddle  pairs  is  particularly  simple.  Let  {or,  /3}  be 
a  straddle  pair  such  lat  a’ebasin{/l}  and  /3ebasin{B}.  We  define  y  to  be  the 
midpoint  of  the  straight  line  segment  [a,  j3],  that  is,  y  =  (or  +  j3)/2.  If  y  6  basin{/l} 
then  we  choose  a*  =  y,  /3*  =  j3;  otherwise,  if  y  e  basin{B}  then  we  choose  a*  -  a, 

=  y.  This  refinement  procedure  is  also  called  the  bisection  procedure. 

The  solution  to  the  ‘basin  boundary  dynamic  problem'  is  the  straddle  trajectory 
using  the  bisection  procedure.  We  call  the  sequence  of  tiny  straight  line  segments 
a  basin  boundary  straddle  trajectory  or  BST  trajectory,  and  we  call  the 
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straddle  method  above  that  generates  the  BSt  trajectory  the  basin 

boundary  straddle  trajectpiy  method  ox  BST  method.  Notice  that  each  tiny  line 
segment  in  a  BST  trajecto^  straddles  the  basin  boundary.  A  BST  trajectory 
typically  resembles  (after  a  few  iterates)  a  basic  set  in  the  basin  boundary. 

SST  method.  The  ‘saddle  dynamic  restraint  problem’  is  to  describe  a  numerical 
method  for  finding  a  . trajectory  that  remains.in  a  specified  transient  region  for  an 
arbitrarily  long  period  of  time. 

First,  we  describe  the  refinement  procedure  that  is  involved  in  the  current 
straddle  methliod;  Let  {a,  b}  be  a  pair  such  that  [a,  b]  intersects  S{R)  transversaiiy. 
The  notation  (a;,  y,  z)  for  a  triple  means  that  x,  y,  and  z  lie,  on  [a,  b]  arid  y  is 
between  x  and  z,  and  we  assume  for  convenience  that  the  ordering  on  [a,  b]  is  such 
that  x<y<z.  For  each  e  >  0,  an  e-refihement  of  a  triple  (a:,  z,  y)  is  an  e-refinemerit 
of  {x,  y}  such  that  it  includes  z.  Let  (or,  y,  /3)  be  a  triple  on  [a,  b].  We  call  (cr,  y,  /3) 
an  Inter  or  Maximum  triple  if  both  Tr(y)  >  Tr^oc)  and'.rR(y)  >  Tr{^)}  ;  and  we  call 
(a,  y, /3)  a  PIM  triple  if  (or,  y,  j3)  is  an  Interior  Maximum  triple  and  p-(v|l< 
||b-a||. 

Let  (or,  y,  P)  be  an  Interior  Maximum  triple,  and  let  P  be.  an  e-refinement  of 
(or,  y, /3).  The  procedure  that  selects  in  the  ,  refinement  P  any  PIM  triple 
(a*,  y*,  p*)  is  called  a  PIM  triple  {refinement)  procedure. 

The  solution  to  the  ‘saddle  dynamic  restraint  problem’  is  the  straddle  trajectory 
using  the  PIM:triple  procedure.  We  call  the  sequence  of  tiny  straight  line  segments 
{Qn»a  a  saddle  straddle  trajectory  or  SST  trajectory,  and  we  call  the  straddle 
method  that  generates  the  SST  trajectory  the  saddle  straddle  trajectory 

method  OT  SST  method.  Notice  that  each  tiny  line  segment  in  an  SST  trajectory 
straddles  a  piece  of  a  (chaotic)  saddle.  An  SST  trajectory  typically  resembles  (after  a 
few  iterates)  a  basic  set  in  the  chaotic  saddle. 

ASST  method.  The  ‘accessible  saddle  dynamic  restraint  problem’  is  to  describe  a 
numerical  method  for  finding  a  trajectory  on  the  stable  set  S{R)  that  is  accessible 
from  the  transient  set  R\S{R). 

The  refinement  procedure  that  is  involved  in  the  current  straddle  method  is  a 
PIM  triple  (refinement)  procedure  in  which  a  PIM  triple  {a*,  y*,  p*)  is  selected 
from  the  e-refinement  P  of.the  interior  maximum  triple  {a,  c,  b)  such  that  [a,  a*]  is 
in  the  transient  set  R\S{R)  (hence,  [a,  a*]  does  not  intersect  the  stable  set  S{R)), 
This  refinement  procedure  is  called  the  accessible  PIM  triple  {refinement)  procedure. 

The  solution  to  the.  ‘accessible  saddle  dynamic  restraint  problem’  is  the  straddle 
trajectory  using  the  accessible  PIM  triple  procedure.  We  call  the  straddle  trajectory 
{4i}n>o  an  accessible  saddle  straddle  trajectory  or  ASST  trajectory,  and  we  call  the 
straddle  method  that  generates  the  ASST  trajectory  the,  accessible  saddle 

straddle  trajectory  method  or  ASST  method.  An  ASST  trajectory  typically  resembles 
(after  a  few  iterates)  a  subset  of  the  non-wandering  points  in  R  which  are  accessible 
from  the  transient  set  R\S{R). 

In  most  cases  that  we  have  investigated  we  find  that  every  e-refinement  of  two 
points  {a,  b),  when  e  is  chosen  to  be  1/30,  includes  several  PIM  triples.  In  [NYl], 
[NY2]  we  find  that  the  ASST  method  leads  to  accessible  fixed  points  or  periodic 
points,  which  is  in  agreement  with  the  fact  that  all  the  accessible  points  for  two 
dimensional  hyperbolic  systems  are  on  the  stable  manifolds  of  finitely  many  periodic 
points.  In  [NY2]  we  have  shown  that  the  two  PIM  triple  procedures  are  valid  in 
ideal  situations  (hyperbolic  systems).  We  find  SST  and  ASST  methods  work  well  in 
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practice  even  in  less  than  ideal  cases.  From  the  examples  in  [NYl],  we  have  seeii 
that  the  SST  method  works  quite  well  fora  variety  of  dyn^ical  systems^ 

Most  pictures  in  section  3  for  which  one  of  the  numerical  straddle  procedure  has 
been  applied  in  order  to  obtain  a  single  numerical  trajectory,  have  been  obtained  by 
selecting  e  =  1/30  as  default  value,  and  ne^ecting  the  first  10  iterates.  We  chose  e  to 
be  somewhat  smaller  (0.01)  in  the  ABST  method  for  the  Henon  map  (parameter 
values  p  =  2;66,  p  =  0.3). 


6.4.  Shadowing 

It  is  important  to  ask  if  such  straddle  trajectories  obtained  by  one  of  the  straddle 
methods  (BST  method.  SST  method.  ASST  method,  or  ABST  method)  represent 
true  trajectories  of  the  system.  In  other  words,  does  there  exist  a  true  trajectory  of 
the  system  that  shadows  (i.e.  stays  close  to)  the  numerical  trajectory  obtained  by  a 
straddle  method?  When  a  map  is  sufficiently  hyperbolic  oh  the  invariant  set  in 
question,  Bowen  [B]  obtained  a  result  saying  that  each  noisy  trajectory  in  the 
on-wandering  set  can  be  shadowed  by  a  true  trajectory  if  the  perturbation  is  small; 
see  [B]  for  the  precise  statement.  Recall  that  Inv(R)  satisfies  the  ‘no  cycle  condition’ 
if  whenever  basic  sets  F^d), ....  r*(.M)  is  a  sequence  of  basic  sets  in  Inv(/?)  for  which 
the  stable  set  of  has  a  non-empty  intersection  with  the  unstable  set  of  for 
all  l^i<k(M),  then  the  stable  set  of  does  not  intersect  the  unstable  set  of 
F*(,).  Assuming  Inv(/?)  satisfies  the  ‘no  cycle  condition'  and  6  is  sufficiently  small, 
we  can  show  that  every  BST  or  SST  trajectory  of  a  two  dimensional  uniformly 
hyperbolic  system  with  a  fractal  basin  boundary  or  a  chaotic  saddle,  obtained  by  the 
BST  method  and  SST  method  respectively,  can  be  shadowed  by  a  true  trajectory 
(for  as  long  as  the  saddle  straddle  trajectory  can  be  computed). 


7.  Concluding  remarks 

7. 1.  Higher-dimensional  systems 

One  of  the  ingredients  in  the  analysis  of  the  validity  of  the  accessible  basin  boundary 
procedure  in  dimension  two,  is  the  existence  of  a  C'^"  foliation  Jy"  on  a 
neighbourhood  of  a  basic  set.  The  proofs  of  the  basin  boundary  geometric  lemma 
and  the  basin  boundary  combinatorial  lemma  require  the  existence  of  such  a  stable 
foliation  (see  also  the  proof  of  geometric  lemma  II  in  [NY2],  on  which  the  proof  of 
the  basin  boundary  geometric  lemma  is  heavily  based).  For  d  =  2,  the  existence  of 
such  a  foliation  is  guaranteed  by  a  result  due  to  De  Melo  [M].  Unfortunately,  the 
existence  of  a  foliation  5*  on  a  neighbourhood  of  a  basic  set  in  higher  dimensions  is 
not  known,  see  e.g.  [PT]. 

Let  from  now  on,  the  dimension  d^3.  Let  Fbe  an  Axiom  A  diffeomorphism,  let 
/?  be  a  basin  boundary  region  such  thr.t  dim  £“  =  1,  and  assume  that  for  each  basic 
set  F  in  Inv(/?)  there  exists  a  C’’*'"  staule  foliation  S'*  on  a  neighbourhood  of  F,  for 
some  O'  >  0.  Then  the  conclusion  of  the  theorem  is  again  valid.  The  proof  is  almost 
the  same;  instead  of  proposition  5.2  one  should  use  the  properties  of  Markov 
partitions  of  basic  sets;  see  Bowen  [B]. 


Acc^ible  trajectories  on  basin  boundaries 
7.2;  Order  of  differentiability  of  the  dijfeomdrphism 
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We  assumed  that  the  diffeomorphism  f  is  C^.  This  assumption  implied  the  existence 
of  a  expanding  map,  for  some  ar>0,  in  proposition  5.3;  If  F  is  of  class  C^ 
then  |t  is  known  that.such  an  expanding.map  is  C'.  We  would  like  to  point  put,  that 
the  Holder  exponent  a  is  only  used  to  obtain  (2)  in  the  proof  of  the  Geometric 
lemma  I  in  (NY2J;  the  proof  of  the  basin  boundary  Geometric  lemma  depends 
indirectly  on  this  result.  Fortunately,  we  can  prove  Geometric  lemma  I  in  [NY2]  (in 
particular  the  property  (2)  mentioned  above)  for  the  C'-map  w  of  proposition  5.3  by 
combining  the  techniques  of  the  proof  of  proposition  6  in  [Ne]  and  lemma  5.5  in 
[Nul].  Thus  in  fact,  it  is  sufficient  to  assume  F  is  to  guarantee  the  main  result  of 
the  paper. 


7.3.  An  ad  hoc  numerical  technique 

[GOYlJ  describes  ah  ad  hoc  straddle  technique  for  determining  accessible  periodic 
saddle  points  on  the  basin  boundary.  In  [GOYl]  it  is.pssumed  that  there  are  two 
attractors  A  and  B.  The  objective  in  [GOYl]  is  to  find  a  saddle  periodic  point  on  the 
basin  boundary  that  is  accessible  from.basin{5).  Thjs-meihod  worked  on  several 
test  problems  but  had  no  rigoroys  foundation.  The  objective  of  this  paper  is  to 
attack  the  problem  raised  in  [GOYl]  and  we  find  a  straddle  method  (ABST 
method)  which  has  a  rigorous  foundation. 


7.4.  Examples 

By  using  the  SST  method,  in  the  example  of  the  Henon  map  with  parameter  values 
p  =  1.81257970,  p  =  0.022864  30  the  resulting  SST  trajectory  gives  virtually  the 
same  picture  as  figure  4  (which  was  generated  using  the  BST  method).  Also  in  this 
case,  the  ASST  trajectory  is  similar  to  the  ABST  trajectory. 

In  the  second  Henon  e.xample  (p  =  2.66,  p  =  0.3)  we  choose  in  the  ABST 
method  e  =  0.01;  the  ASST  method  gives  a  similar  result  when  e  =  1/30  is  chosen. 


7. 5.  Smooth  or  fractal  basin  boundaries 

The  accessible  basin  boundary  procedure  is  valid  for  smooth  as  well  as  fractal  basin 
boundaries. 
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We  prcscni  an  cii'iciciu  aleoriilim  lur  uikulaung  uipoloiiii.il  i.iuiopies  ui  ^h.uuiv  u>»amn.,d  v^^u■lr.v  I  he  au  iluid  applies  lo 
cliaoiic  auraciors  as  well  as  cliaoiic  saddles, 


The  quaniiialive  characierizaiioii  ot'chaoUc  pro¬ 
cesses  has  proven  lo  be  an  imporiani  issue  in  non¬ 
linear  dynamics.  Calculaiions  of  Lyapunov  expo¬ 
nents  and  fractal  dimensions  have  been  verv  useful 
in  this  regard,  \nother  fundamental  quantitv  is  the 
topological  entropv  (1,2].  which  eharactcri/es  the 
complexity  of  the  orbit  structure  of  4  given  dynam¬ 
ical  system.  The  topological  entropy  is  invariant  un¬ 
der  topological  conjugacy  of  the  dy  namical  systems 
(i.e.  it  is  preserved  by  eontinuous  and  not  necessar¬ 
ily  differentiable  changes  of  variables). 

The  general  definition  of  topological  entropy  is 
eompuiaiionally  unwieldy,  so  saleulaiions  invaria¬ 
bly  depend  on  iheorems  which  give  simplei  if  le.ss 
general  definitions. 

For  an  a.viom  \  diffeomorphism  /'  (see  ref.  j.3] 
for  a  definition  of  the  conditions  saiisfied  by  an  ax¬ 
iom  \  system)  the  lopologival  entropy  is  the  cepo- 
nential  growth  rate  of  the  numbei  uf  neriodie  points 
(3  j.  Let  be  the  number  of  fixed  points  of  ihe  n 
limes  iterated  map  /'".  thus.  /’„  eounis  the  numbei 
of  points  of  period  11  plus  ihe  number  of  points  whose 
period  diviilcs  11.  The  lopologieal  entropy.  /.(/  ). 
satisfies 


n  .CO 

Thus  for  .V  sufficiently  large,  we  have  the  ap¬ 
proximation 

'  Also  al.  Departmem  of  Elcvlrieal  Engineering  and  Depan- 
mcni  of  Physics. 


Chaolie  sy .stems  encountered  m  appiiealions  are  often 
not  axiom  \.  Nevertheless,  lor  non-a.xiom  A  siiua- 
lions.  It  IS  often  assumed  that  eq,  (2)  continues  to 
hold.  Even  ,so.  ehaotu.  systems  tend  to  be  numeri¬ 
cally  unstable,  and  this  can  make  it  difficult  to  ob¬ 
tain  a  sufficiently  large  number  of  periodic  orbits  lo 
use  in  eq.  (2).  Calculations  based  on  this  method 
lequire  ingenuity  and  have  been  earned  out  in  a  few 
cases  l-t.5|. 

XiHdher  .ippro.ieh  due  ti>  New  nouse  .ind  'I'onulin 
lelatcs  .he  tvipolugicai  entiopy  tu  the  maximum  ex¬ 
ponential  growih  rate  of  a  A-dimensional  volume  in 
the  phase  space  ( 1  j.  For  two-dimensional  maps. 
Newhouse  uses  the.se  lesults  to  obtain  numerical 
bounds  on  the  entiopy  by  vomputing  the  exponential 
giowih  rate  of  the  length  ol  a  typical  line  segment. 

Recenily.  a  more  sophisticated  technique  based  on 
genciating  partitions  of  ^luioiic  attractors  has  been 
proposed.  This  iiicihad  seems  lo  yield  precise  esti¬ 
mates  on  topological  eniiopies.  However,  generating 
partitions  are  usually  difficult  to  construct  (6). 

In  this  note,  we  introduce  a  new  algorithm  for  cal¬ 
culating  the  topological  entropy  which  is  iiarticularly 
simple  and  efficient,  and  may  in  some  cases  have 
some  advantages  over  previous  methods.  It  applies 
to  chaotic  attractors  as  well  as  chaotic  saddles. 

Consider  an  invertible  map  of  the  plane  (.v',  r') 
=  /■■(  V.  .1 ).  Choose  a  compact  volume  V.  Normally 
we  choose  V  to  contain  the  chaotic  invariant  set  of 
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the  map.  However,  since  the  topblop.ical  entropy,  of 
F  is  bounded  below  by  the  entr6p\  ■'  restricted  to 
any  subregion;  our  algorithm  obta...j  lower  bounds 
eveh'when  this  is  not  the  case.  This  fact  is  useful  if 
one  does  not  know  a  priori  bounds  on  the  dynamics. 
We  assume  that  under  the  action  of  the  inverse  map 
F  “ ' ,  all  points  in  V  except  for  a  set  of  Lebesgue  mea¬ 
sure  zero  (the  invariant  set  and  its  unstable  mani¬ 
fold)  eventually  escape  V.  This  is  true,  for  example, 
for  area  contracting  maps  such  as  the  dissipative 
Henon  map.  Consider  the  intersection  of  V  with  its 
preimages,  '  V„=VnF“'(V)r>F“^(V)h...o 

F"''(V).  For  large  /).  V„  generally  consists  of  dis¬ 
joint  elongated  strips  mg  in  the  direction  of  the  sta¬ 
ble  manifold  of  F  for  the  invariant  set  contained  in 
V.  In  the  limit  h-*oo.  V„  is  the  intersection  of  the 
stable  manifold  with  V.  Let  us  denote  the  total  num¬ 
ber  of  disjoint  components  in  V„  by  N„  (in  the  case 
of  the  standard  horseshoe  map,  this  number  is  2"). 

The  theoretical  oasis  for  our  algorithm  lies  in  the 
following  model  situation  (see  ref.  [7] ).  Let  V  be  a 
rectangle  whose  sides  are  roughly  parallel  to  the  sta¬ 
ble  and  unstable  directions  of  the  invariant  set.  If 
F(V)nV  consists  of  m  horizontal  strips  and 
F  ■ '  ( V )  n  V  consists  of  n>  vertical  strips,  and  F  uni¬ 
formly  contracts  horizontal  strips,  and  F“'  uni¬ 
formly  contracts  vcnical  strips,  then  F  restricted  to 
the  non-empty  invariant  set  A  =  nj^_oo F'(V)  is 
conjugate  to  the  full  shift  on  m  symbols  which  has 
entropy  logm  and  therefore  the  map  F  has  entropy 
at  least  logm  (see  rei.  [7]  for  details). 

Given  the  region  V  and  the  map  F,  often  the  above 
hypotheses  are  not  satisfied,  but  are  satisfied  by  an 
iterate.  F"  and  a  possibly  smaller  region  V’<=V“'. 
Recalling  that  N„  is  the  number  of  disjoint  strips  in 
F""(V)nV  the  above  argument  implies  that  the  en¬ 
tropy  of  F"  is  at  least  logA^„.  Since  /i(F")=«/i(F), 
we  define 

5n  =  logA„+i-logA^„.  (3) 

If  the  above  hypotheses  are  satisfied  by  the  region  V 
and  iterate  n,  the  above  estimate  forms  a  rigorous 
lower  bound.  In  car  ere  explicit  checking  of  these 

hypotheses  is  impr^-iical,  we  examine  convergence 


“  Recall  that  the  topological  entropy  of  F  restricted  to  V  gives 
a  lower  bound  for  the  topological  entropy  of  F  restneted  to  V. 
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behavior  of  s„  for  large.«.  Alternatively,  we  can  plot 
log  Art  versus  n  arid  estimate  /i(F)  as  the  slope  of  the 
fitted  curve  -  (discarding  a- suitable  nutnber  of  small 
n  values ). 

To  obtain  an  estimate  of  the  number  of  disjoint 
strips  in  Vrt,  lei  T{.x)  denote  the  smallest  value  of  n 
such  that  F~''{x)  is  not  in  V.  We  call  7^(.v)  the  in¬ 
verse  escape  time  from  V.  Now  consider  a  line  cut¬ 
ting  transversely  across  the  stable  manifold.  Then  this 
line  also  cuts  through  all  strips  in  Vn  for  large  n,  since 
each  strip  of  V„  lies  basically  along  the  direction  of 
the  stable  manifold.  Hence.  N„  is  given  by  the  num¬ 
ber  of  intervals  where  T(.x)^n  in  a  typical  one- 
dimensional  line  cut.  In  practice,  we  count  the  num¬ 
ber  of  such  intervals  where  T(.x)  n  for  successively 
larger  values  of  n  and  calculate  the  quantity  s„  up  to 
a  certain  level,  or  until  it  converges  within  a  given 
tolerance.  Although  h  obtained  in  this  fashion  only 
gives  a  lower  bound  for  the  topological  entropy,  for 
all  the  systen.s  where  contparisons  with  previous  cal¬ 
culations  arc  available,  this  algorithm  appears  to  yield 
very  sharp  lower  bounds. 

We  remark  that  in  studying  chaotic  scattering  in 
two-dimensional  Hamiltonian  flows.  Kovacs  and  Ttfl 
have  obtained  a  similar  quantity,  Kq,  for  the  Poin¬ 
care  map  on  a  surface  of  section.  They  call  Aq  the 
topological  entropy  of  the  scattering  process  (8]. 
Their  method  is  similar  to  ours  except  that  we  use 
F"'  while  they  use  F  (the  topological  entropy  of  a 
map  and  its  inverse  arc  the  same).  Using  F  how¬ 
ever.  allows  us  to  obtain  the  entropy  of  chaotic  at¬ 
tractors  (this  is  not  possible  using  the  method  of  ref. 
(8),  which  was  designed  for  chaotic  saddles). 

We  first  illustrate  our  algorithm  for  the  Henon 
map, 

.Vrt+i=a-.v^  +  /^Vrt.  .v„+i=.Vrt.  (4) 

Set  (>=0.3,  in  the  parameter  range  1.4<a<4.0.  the 
invariant  set  of  the  Henon  map  changes  from  a 
strange  attractor  to  a  strange  saddle,  and  finally  to  a 
full  2-shift  (horseshoe).  For  a  sufficiently  large,  the 
topological  entropy  saturates  at  log  2.  It  can  be  shown 
that  the  invariant  set  of  the  Henon  map  is  included 
in  the  square  max(|.Y|,  |vi)<F,  where  [9] 

R=\{\  +  \b\  +  [{l  +  \b\)‘+4a]'^^} . 

This  is  the  region  V  which  we  use  for  calculating  the 
inverse  escape  time  function.  For  simplicity,  we  take 
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a  vertical  one-dimensiohal  line  through,  the  origin 
.\=0..v=0and  calculate  T(.\)  at  regularly  spaced  in¬ 
tervals.  This  is  shown  in  fig.  1  for  a=3.0.  where  the 
invariant  set  is  topologically  a  . full  2-shift  (horse¬ 
shoe).  There  is  a  natural  Cantor  set  levej  structure 
in  the  inverse  escape  time  function.  At  level  1,  there 
ac  two  intervals  from  which  it  requires  at  least  two 
backward  iterations  to  escape  the  square  V;  at  level 
2.  there  are  four  intervals  from  which  it  requires  at 
least  three  backward  iterations  to  escape  V.  etc.  The 
intersection  of  these  intervals  is  the  intersection  of 
the  stable  manifojd  of  the  invariant  set  with  the  ver¬ 
tical  a.xis. 

I  'sing  a  double-precision  algorithm,  we  arc  able  to 
calculate  the  inverse  escape  time  function  up  to  level 
20.  The  algorithm  is  implemented  as  follows.  Start¬ 
ing  from  the  initial  interval  fo  S'vcn  by  the  intersec¬ 
tion  of  the  vertical  axis  with  V,  we  interpolate  ?,)  with 
a  uniform  grid  of  iV=:50  points  and  calculate  the  in¬ 
verse  escape  time  for  each  point  with  cutoff  time 
11=2.  VVe  find  all  the  intervals  ?i’s  in  the  grid  where 
the  inverse  escape  time  function  is  greater  than  1. 
We  then  interpolate  again  each  interval  8i  with  50 
points,  calculate  the  inverse  escape  time  for  each 
point  svith  cutoff  time  ii  =  X  and  find  all  the  subin¬ 
tervals  8:’s  where  the  inverse  escape  time  function  is 
greater  than  2,  etc.  Assuming  each  iteration  of  the 
Henon  map  costs  about  10  machine  instructions  and 
the  topological  entropy  to  be  calculated  is  log  2.  the 
whole  calculation  up  to  level  1 5  then  costs  approx¬ 


imately  32  million  machine  instructions.  On  a  10 
MIPS  workstation,  the  whole  corhputation  takes  ap¬ 
proximately  3  s.  We  can  achieve  better  precision  by 
going  to  higher  levels  or  interpolating  more  points  in 
the  gnd.  The  calculation  time  typically  increases  with 
the  level  at  an  exponential  rate  given  by  the  topo¬ 
logical  entropy.  Usually,  level  lO'calculation  ( 1  mil¬ 
lion  machine  instructions,  or  0.1  s  on  a  10  MIPS 
workstation)  yields  good  estimates  on  the  entropy 
for  chaotic  systems.  (For  instance,  for  the  Henon  at¬ 
tractor  at  a=  1.4.  /;=0.3.  level  10  calculation  gives 
.s  =  0.660.  while  level  15  gives  .9= 0.670.  a  relative  er¬ 
ror  of  less  than  2%.  Note  this  value  is  consistent  with 
the  one  obtained  in  ref.  (6).)  In  all  our  numerical 
examples,  the  logarithms  are  taken  to  be  base  2. 

Fig.  2  shows  the  topological  entropy  for  the  Henon 
map  at  /j=0.3  in  the  parameter  range  l.4<a^3.0. 
It  is  calculated  with  100  interpolation  points  at  level 
15.  This  figure  seem-,  to  be  identical  (with  better 
precision)  with  the  one  obtained  by  Biham  and 
Wenzel  (4).  Note  that  there  are  plateau  regions  where 
the  entropy  is  constant.  This  is  because  for  any  pa¬ 
rameter  value  where  the  invariant  set  is  hyperbolic, 
the  topological  entropy  must  be  locally  constant  due 
to  the  structural  stability  of  hyperbolic  sets.  The 
whole  calculation  with  260  parameter  values  takes 
about  50  min  on  a  10  MIPS  svorkstation. 

We  also  apply  our  method  to  open  Hamiltonian 
systems.  Generically.  the  phase  space  of  Hamilto- 
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Fig.  1.  The  inverse  escape  time  function  for  the  Henon  map  at 
a = 3.0. 6 = 0.3  for  a  venical  cut  through  the  ongin  a = 0.  >  =  0. 
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Fig.  2.  The  topological  entrepy  for  the  Henon  map  as  a  function 
ofc2at6= 0.3.  This  graph  is  obtained  using  the  method  desenbed 
in  the  text  at  level  1 5  with  100  interpolation  points. 
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nian  systems  has  mixed  components  [10]:  regular 
rotational  motions  of  KAM  type,  and  irregular  mo¬ 
tions  with  positive  Lyapunov  exponents.  If  the  ir¬ 
regular  component  is  noncompact,  its  only,  bounded 
invariant  subsets  are  strange  saddles.  The  mpologi- 
cal  entropy  is  related  to  the  escape  dynamics  from 
the  saddle  [5]i  We  wish  to  calculate  the  topological 
entropies  of  such  systems.  One  example  is  given  by 
the  area-preserving  sawtooth  map  on  the  plane  [5], 

yil  +  \ —yn"^  <  A'n  + 1  “•Tf,  ■b.Vn+ 1  .  (5) 

Here/(.v)  is  a  sawtooth  function. 

/(.v)=.v-0.5-|.v],  (6) 

where  [.v]  denotes  the  greatest  integer  in  .v.  Note  that 
./’(.v)  is  discontinuous  on  the  line  .v=0.  therefore  the 
sawtooth  map  is  piecewise  linear  with  constant  Ja¬ 
cobian  matrix  c.xcept  on  the  line  .v=0.  The  nonlin¬ 
earity  of  the  map  comes  from  this  line  of  disconti¬ 
nuity.  For  the  map  is  uniformly  hyperbolic 
except  on  the  discontinuity  line,  hence,  there  are  no 
KAM  curves  in  the  phase  space.  The  Lyapunov 
number  A  is  related  to  the  parameter  K  by 

/l  =  l-b0.5[A:+(A:H4A')'/-|  . 

I  ..er  the  action  of  the  sawtooth  map,  almost  all  ini¬ 
tial  conditions  inside  the  fundamental  region  Vs  <;.v: 
1.y|<0.5}  escape  to  infinity.  It  can  be  shown  that 
there  is  an  unstable  invariant  set  T  in  V  [5].  Fig.  3 
shows  this  invariant  set  at  /I  =  2.4.  We  will  calculate 
the  topological  entropy  for  this  invariant  set  as  a 
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Fig.  3.  The  unstable  invanant  set  for  the  sawtooth  map  at  /! = 2.4. 


function  of /I. ,( We  lioteThat  the  topological  entropy 
of  the  sawtooth  map  defined  on  the  plane  is  different 
from  the  topological  entropy  of  the  same  map  de¬ 
fined  oh  the  torus.  In  the,  latter  case,  the  space  is 
compact,  the  chaotic  invariant  sefis'the  whole  torus, 
which  contains  F  as  a  subset,  the  topological  en¬ 
tropy  of  the  latter  is  g;  ■  en  by  the  Lyapunov  exponent 
log  A,  the  uniform  expansion  rate  of  a  line  segment. ) 
When  /1>3.  we  can  show  that  the  invariant  set  is  a 
full  2-shift  (5),  therefore,  the  topological  entropy 
saturates  at  log  2  when  /!>  3. 

For  convenience,  we  choose  the  cut  at  .v=  -0.5. 
The  topological,  entropy  is  shown  in  fig.  4  for  2^ 
/I  ^3.  The  solid  curve  is  the  entropy  obtained  by 
counting  the  number  of  periodic  points  of  the  map 
by  using  the  coding  scheme  of  ref.  [5],  the  dots  are 
entropies  calculated  with  our  algorithm  at  level  18. 
The  agreement  is  excellent.  When  /I  <2.  the  conver¬ 
gence  for  both  methods  becomes  slow,  and  we  find 
it  prohibitive  to  obtain  the  entropy  value  Without 
going  to  a  higher  precision  algorithm.  We  note  that 
there  is  no  apparent  plateau  structure  in  fig.  4.  This 
is  because  the  invariant  set  is  not  everywhere  hy¬ 
perbolic  in  this  parameter  range. 

We  have  also  calculated  the  topological  entropy  for 
the  corresponding  invariant  set  of  the  standard  map 
on  the  plane.  The  standard  map  is  given  by  replacing 
the  impulse  function  in  (5)  with  a  sinusoidal  func¬ 
tion  [  10). 
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Fig.  4.  The  lopological  entropy  as  a  function  of  A  for  the  saw¬ 
tooth  map.  The  solid  curve  is  the  entropy  obtained  by  counting 
the  number  of  n-cycle  fixed  points,  the  dots  are  the  level  18  cal¬ 
culations  with  100  interpolation  points. 
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/■{.v)=-sin(27t.r)/2rt.  (7) 

For  moderately  large  values  of  K  (of  •'rder  1 ),  the 
motion  ,in  the  phase  space  has  both  regular  and  ir¬ 
regular  components.  However,  when  the  parameter 
K  is  large,  the  map  is  almost  hyperbolic  (10).  There¬ 
fore.  the  invariant  set  contained  in  the  fundamental 
region  V=  <.v:  |.v|  <0.5j  is  a  strange  saddle  for  large 
K.  In  fig.  5.  we  show  the  topological  entropy  in  the 
parameter  range  5.0  ^  /v  ^  9.0  calculated  using  our  al¬ 
gorithm  at-level  10  (again  logarithms  are  calculated 
in  base  2).  We  see  that  at  /f»8.4.  the  topological  en¬ 
tropy  saturates  at  log  3.  indicating  the  invariant  set 
IS  topologically  a  3-shift.  Indeed,  this  is  the  typical 
dynamics  of  the  standard  map  for  large  parameter  K, 
We  again  note  that  in  the  entropy  function  there  are 
obvious  plateau  regions  where  the  topological  en¬ 
tropy  remains  constant,  similar  to  the  case  of  the 
Henon  map. 

2,0 - , - 


h  1.0  ’ 


0,5  . 


0,0^ - 
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Fig.  5.  The  lopological  entropy  for  the  standard  map  as  a  func¬ 
tion  of  K.  100  interpolation  points  at  level  10. 
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In  conclusion,  we  have  presented,  ah  efficient  al¬ 
gorithm  for  calciilating-the  topological  entropy  of 
chaotic  dynamical  systems. 
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ABSTRACT 

Numerical  experiments  on  a  symplectic  coupled  map  system  are  performed  to  inves¬ 
tigate  the  tendency  for  global  ergodic  behavior  of  typical  Hamiltonian  systems  as  the 
number  of  degrees  of  freedom  N  is  increased.  As  N  increases,  we  find  that  the  fraction 
of  pheise  space  volume  occupied  by  invariant  tori  decreases  strongly.  Nevertheless,  due 
to  observed  very  long  time  correlated  behavior,  a  conclusion  of  effective  gross  ergodicity 
cannot  be  confirmed,  even  though  extremely  long  numerical  runs  were  employed. 
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The  basic  assumption  in  stati^ic^  mechanics  is  that  of  ergodicity  over  the  ph^e 
space  hypersurface  determined  by' the  global  constaiits  of  the  motion  (e.g.,  total  ener^,, 
total  angular  momentum,  etc;).  On  -the  other  hand,  studies  of  Hamiltonian  systems 
with  few  degrees  of  freedom  (e.g.,  two)  typically  reveal  the  presence  pf  .iiivjariant  I^AM 
tori  ill  addition  to  chaotic  orbits;  ^d  the  existence  of  KAM  tori  yields  motipn  that 
is  grossly  differeiit  from  that  assumed  in  statistical  mechanics.  A  natural  supposition 
reconciling  the  above  contradictory  views  might  be  that,  as  the  number  of  degrees  of 
freedom  is  increased,  the  tendency  for  global  ergodicity  increases.  By  “tendency  for  global' 
ergoi-.city”  we  mean  that,  for  systems  with  many  degrees  of  freedoih  (the  situation  of 
interest  in  statistical  mechanics),  the.  overwhelming  majority  of  initial  conditions  would 
be  ergodic  over  effectively  all  of  the  area  of  the  phase  space  hypersurface  determined  by 
the  global  constants  of  the  motion. 

The  purpose  of  this  paper  is  to  present  numerical  experiments  which  attempt  to  test 
this  supposition  in  a  specific  case.  In  particular,  wt  study  a  symplectic  map  system  (the 
symplectic  condition  insures  that  the  dynamics  is  Hamiltonian).  A  closely  related  work 
is  that  of  Falcioni  et  al.'  For  other  previous  relevant  works  on  Hamiltonian  dynamics  in 
higher  number  of  degree  of  freedom  systems  see  Kaneko  and  Baglcy,^  Gyorgyi  et  al.,^ 
and  the  discussion  and  references  in  the  book  by  Lichtenberg  and  Lieberman.'*  The  main 
result  of  the  present  paper  is  that,  for  the  system  we  study,  the  fraction  of  orbits  on  tori 
decreases  very  strongly  as  the  number  of  degrees  of  freedonr-js  increased,  but  there  is  still 
no  conclusive  evidence  for  effectively  complete  global  ergodicity  even  over  the  very  long 
times  investigated  in  our  numerical  experiments.  The  latter  is  due  to  the  extremely  long 
time-scales,  insensitive  to  machine  precision,  observed  in  the  numerical  experiments. 

The  system  we  studied  derives  from  the  standard  map, 


(1) 


x'  =  X  +  XJ, 

xj'  =  y  +  k  sin  x'. 

In  these  coordinates  the  map  can  be  considered  as  a  map  of  the  two-torus  0  <  x  <  27r 
and  0  <  y  <  27r. 

Given  a  positive  integer  iV,  consider  the  space  (T^)^  thought  of  as  2n-tuples 
(xo,yo,a;i,.yi)-- j2:iv-i,yiv-i)*  We  define  a  coupled  standard  map  allowing  symmetric 
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Bidirectional  nearest  neighbor  interactions, 

=  x,  +  „,  •  ,  ^2) 

y'i  =  y«  +  K  sin  x'-  +  CK  sin(i  ■  x\_y  )  +  CK  sin(a:  ■  -  i ), 

where  the  indices  are  taken  modulo  N  and  x,-,  y,-  are  taken  modulo  27r.  Here  C  is  the 
coupling  parameter  to  nearest  neighbors.  Letting  K  =  k/{2C  4*  1),  Eqs.  (2)  reduce  to 
Eqs.  (1)  for  N  =  1.  We  call  k  the  nonlinearity  parameter.  This  map  is  symplectic  since 
it  can  be  obtained  from  the  generating  function, 

F(x,  x')  =  ^  4-  K cos  X;  4-  CK  cos(x{  -  (3) 

2  1=1 

One  checks  readily  that  y,-  =  OFJdxiy  y-  =  —dF/dx\. 

The  original  aim  of  our  numerical  experiments  was  the  exploration  of  the  relative 
measure  of  KAM  tori  as  a  function  of  the  number  of  coupled  maps.  To  this  end,  we 
first  note  that  motion  on  KAM  surfaces  is  quasiperiodic  with  all  Lyapunov  exponents 
zero,  while  motion  not  on  KAM  surfaces  typically  is  chaotic  and  has  at  least  one  positive 
Lyapunov  exponent.  Thus  we  proceed  as  follows  (see  also  Ref.  1).  A  cutoff  value  e  for 
an  orbit  to  be  considered  quasiperiodic  was  set  and  the  number  of  initial  conditions  with 
largest  Lyapunov  exponent  (LE)  less  than  e  counted.  The  run  consisted  of  taking  m  initial 
conditions  uniformly  distributed  in  the  2JV*torus  and  iterating  them  approximately  lO** 
times  along  with  their  tangent  vectors  to  compute  their  LE’s.  A  cutoff  value  e  =  0.005  for 
the  largest  LE  was  set  below  which  an  orbit  was  considered  quasiperiodic,  and  the  ratio 
of  the  number  of  quasiperiodic  initial  conditions  to  the  total  number  of  initial  conditions 
was  returned. 

When  the  coupling  coefficient  is  zero,  the  volume  of  the  KAM  tori  decays  exponentially 
with  iY.  In  particular,  if  /  denoces  the  fraction  of  phase  space  occupied  by  KAM  tori  for  a 
single  standard  map,  Eq.  (1),  then  the  fraction  of  the  phase  space  (T^)^  for  N  uncoupled 
maps  for  which  motion  in  the  2N  variables  (xq,  yo,  •  •  •  >a:Ar-i)yAr-i)  is  quasiperiodic  is  f^. 
When  C  >  0,  the  rate  of  decay  was  observed  to  increase  dramatically.  Results  for  the 
parameter  values  C  =  0.5,  k  =  0.3  are  displayed  in  Table  1.  In  this  table  the  estimated 
measure  of  quasiperiodic  (QP.)  initial  conditions  (second  column)  is  the  fraction  of  8192 
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randomly  chosen  initial  conditions  yielding  LE’s  less  than  e. 


Maps 

Estimated  Measure  of  QP 
Initial  Conditions 

Iterations 

1 

1.000 

10® 

2 

0.403 

3.25  xld® 

3 

0.048 

3.25  xlO® 

4 

0.002 

3.25  xlO® 

5 

0.000 

1.25  XlO® 

6 

0.000 

10® 

7 

0.000 

10® 

Table  1:  Fraction  of  Initial  Conditions  Yielding  Quasiperiodic  (QP)  Orbits 


Figures  1  show  histograms  of  the  observed  distribution  of  maximum  LE’s  for  the  8192 
randomly  chosen  initial  conditions  for  N  =  .-,3,.. . .  ,7  coupled  maps. 

The  case  of  three  maps  is  presented  twice  with  different  numbers  of  iterations  for  the 
same  set  of  data.  The  observed  peaks  get  sharper  but  the  effect  is  very  slow. 

In  most  cases  the  following  phenomena  were  noted: 

1.  The  number  of  initial  conditions  following  within  the  e  bound  for  quasiperiodicity 
decreases  rapidly  as  the  number  of  maps  increases. 

2.  The  obs-  peaks  grew  sharper  \yith  repeated  iteration — but  very  slowly. 

3.  The  histograms  with  more  than  one  peak  preserved  those  peaks  and  they  individ¬ 
ually  got  sharper. 

These  observati  ns  might  lead  one  to  conjecture  that  each  peak  represents  a  distinct 
ergodic  component  with  its  own  maximum  LE. 

We  now  discuss  the  behavior  of  six  individual  orbits  for  the  iV  =  3  case,  where  the 
orbits  are  chosen  so  that  their  maximum  LE’s  calculated  after  3.25  xlO®  lay  in  distinct 
regions  of  interest  of  the  histogram  in  Fig.  1(c).  The  calculated  LE  values  for  these  six 
orbits  are  indicated  by  the  arrows  labeled  with  the  letters  (a)-(f)  along  the  axis  of  Fig. 
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1(c).  The  projection  of  these  Orbits  onto,  the  first  two  components  (loi  yo)  are,=plotted  for 
lO”*  iterations  in  Figs.  2(a)-(f). 

Distinct  orbits  appeared  to  stay  constrained  in  a  fixed  region  of  phase  space,  and  this 
was  also  true  when  time  series  of  10®  iterations  were  plotted; 

Lyapunov  exponents  were  then  computed  for  each  of  these  orbits  for  a  much  greater 
period  of  time  (3x  10®  iterations).  The  results  are  shown  in  Fig.  3  where  the  letters  (b)r:(f) 
labeling  the  curves  correspond  to  the  orbits  shown  in  Figs.  2(b)-(f)  and  the  arrows  shown 
along  the  horizontfJ  axis  of  Fig.  1(c).  The  first  initial  condition,  which  was  presumed 
quasiperiodic,  remained  stable  during  the  whole  process,  and  in  fact  its  computed  LE 
reached  zero  to  machine  precision.  Initial  condition  (f)  also  remained  at  a  highly  stable 
value.  The  remaining  four,  however,  appear  to  have  started  to  converge,  slowly  to  a  new 
common  value. 

Figures  4  break  down  the  curves  in  Fig.  3  (plus  orbit  (a)]  giving  the  cumulative  LE 
and  a  "local”  LE  which  is  calculated  in  500,000  iterate  bursts.  Observe  the  great  stability 
of  initial  conditions  (a)  and  (f). 

Further  studies  were  conducted  for  a  variety  of  initial  conditions  and  various  behaviors 
were  observed. 

1.  Some  initial  conditions  appeared  to  lead  to  orbits  whose  LE’s  showed  a  great  deal 
of  stability  (they  remained  essentially  unchanged  over  the  observed  time  scale). 

2.  Some  initial  conditions  showed  a  high  degree  of  stability  at  one  value  of  the  maxi¬ 
mum  LE  but  then  “leaked”  into  a  regime  with  a  different  LE. 

3.  Some  initial  conditions  alternated  between  chaotic  behavior  and  behavior  very  close 
to  quasiperiodic. 

One  effect  of  these  observations  was  to  call  into  question  the  reliability  of  the  LE 
calculations  in  general.  Many  of  these  calculations  seemed  to  be  stable  for  greater  than 
10®  iterates  before  changing  value.  Given  the  relative  rarity  of  these  “leaks,”  it  was 
impractical  to  assign  any  numerical  value  to  this  diffusion. 
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The  histogram  calctilations  were  performed  on  a  Connection  Machine  using  (of  neces¬ 
sity)  single-precision,  arithmetic.  The  orbit  calculations  were  performed  on  aOecStation 
3i00  using  double  precision.  To  e.\:amine  the  effect  of  machine  precirioh  several  of  the 
■long-term  LE  calculations  were  done  at  both  single  and  double  precision.  The  observed 
behavior  was  qualitatively  the  same;  the  observed  leakage  between  regions  of  different 
LE  occurred  in  each  case  (at  slightly  different  iterates). 

This  work  was  supported  by  the  Office  of  Naval  Research  (Physics  Branch),  by  the 
Department  of  Energy  (Scientific  Computing  Staff,  Office  of  Energy  Research),  and  by 
the  Defense  Advanced  Research  Projects  Agency. 
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FIGURE  CAPTIONS 

1.  Histogram  of  ih^mum -Lyapunov*  exponents  .for  8192  initial  conditions  and  iV  = 
2,3, ...,7r  For  (a)  the  \'alue  in  the  first  histogram  bin  is  about  2700,  far  off  the 
scale  shown.  Iii  general,  the  \'alue  in  the  first -bin  is  ah  estimate  of  the  hmnber  of 
quasiperiodic  orbits. 

2.  Projection  of  six  individual  orbits  for  N  =  3  onto  the  plane  corresponding  to  the 
first  two  cchiponehts.  10'*  iterations  are  plotted.  The  calculated  maximum  LE’s  for 
th^e  orbits  are  (a)  8  x  10~^  (quasipeiriodr.c),  (b)  0.0166,  (c)  0.0676  [corresponding 
to  the  lower  LE  peak  in  Fig.  1(c)],  (d)  0.1170  [corresponding  to  the  higher  LE  peak 
in  Fig.  1(c)],  (e)  0.1191,  and  (f)  0.1300.  These  LE  values  are  indicated  along  the 
horizontal  axis  of  Fig.  1(c). 

3.  Maximum  calculated  LE  as  a  function  of  the  number  of  map  iterations  for  the  five 
orbits  corresponding  to  Figs.  2(b)-2(f). 

4.  Cumulative  and  “local”  maximum  LE  for  the  orbits  corresponding  to  Fig;  3. 
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METAMORPHOSES:  StlDDEK  JUlffS  IN  BAS^  BOUNDARIES^ 

Dynamical  systems:  in- the  plane  can  have  many- :,coexistihg, -attractors. 
In  order  to  be  able  to  predict  long-term  or  asymptotic  bahavior  in  such 
systems,  it  is  important  to  be  able  to  recoghize  to  which  attractor 
(final  state)  a  given  trajectory  will  tend.  The  set  of  initial  condi¬ 
tions  whose  trajectories  are  asymptotic  to  a  particular  attractor  is 
called  the  basin  of.  attraction  of  that  attractor.  In  some  systems  that 
depend  on  a  parameter,  it  has  been  observed  that  the  boundaries  of  these 
basins  are  extremely  sensitive  to  small  changes  in  the  parameter.  Not 
only  can  a  boundary  jump  suddenly  but  it  can  also  change  -from  being 
smooth  to  being  fractal.  These  changes,  called  boundary  metamorphoses, 
are  studied  at  length  in  [GOY].  In  this  paper,  we  prove  a  theorem, 
originally  stated  in  [GO'^l,  which  characterized  the  jumps  in  basin 
boundaries. 

The  Henon  map  f(x,y)  =  (A-x"-Jy,x)  provides  an  example  of  this 
phenomenon.  We  fix  J  =  0.3  and  vary  A,  resulting  in  a  one-parameter, 
invertible  map  of  the  plane.  The  Jacobian  of  f  is  J;  hence,  f  is 
area  contracting  for  all  A.  We  will  be  looking  specifically  at  the 
boundary  of  the  basin  of  attraction  of  infinity.  (The  basin  of  infinity 
is  the  set  of  all  points  (x,y)  such  that  lf'^(x,y)l  +  «  as  n 
Figures  la  and  1b  show  the  basin  of  infiniuy  in  black  for  A  =  1.31^ 
and  A  =  1.320,  respectively.  In  Fig.  1b  we  see  that  the  basin  of 
infinity  contains  points  which  were  previously  (at  A  =  1.31^)  well 
within  the  white  region.  This  new  set  of  black  points  has  not  gradually 
moved  in  from  the  boundary  of  the  white  region.  Rather,  beyond  a 
certain  critical  value  A  =  A*  «  1.31^5,  black  points  suddenly  begin 
appearing  deep  in  the  interior  of  the  white  region.  As  A  increases. 
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Figure  1  Caption 

Figure  1  shows  the  basin  of  attraction  of  infinity  in  black  for 
the  Henon  map 

f(x,y)  =  (A-x^-Jy.x). 

We  fix  J  =  0.3.  In  Fig.  la  A  is  1.314,  and  in  Fig.  lb  .  A  is 
increased  to  1.32.  The  change  in  the  basin  of  infinity  illustrates  a 

basin  boundary  jump. 


the  thin  bands  thicken.  This  Is  a  discontinuous  change  in  the-  basin  of  ' 
infinity. 

In  order  to  understand  this  phenomena,  we  must  , examine  the  dynam¬ 
ical  behavior  on  the  basin  boundary.  At  A  =•  1.31*<  (Fig.  la)  the 
boundary  is  observed  numerically  to  consist  cf  a  saddle  fixed  point 
p^ ,  and  its  stable  manifold  W®(p^  )..  (The  stable  manifold  W^-(p)  of  a 
fixed-  point  p  is  the  set  of  points  (x,y.)  such  that  f'^(x,y)  p 
as  n  •>  *.  More  generally j  the  stable  manifold  W®(p|^)  of  a  periodic 
point  P(^  of  period  k  is  the  set  of  points  (x,y)  such  that 
f^*^(x,y).  P|^  as  n  Analogously,  the  unstable  manifold  w’''(p|^) 

of  pj^  is  the  set  of  points  (x,y)  such  that  f~'^^(x,y)  +  P|^  as 
n  o».  Such  sets  can  be  proved  to  be  smooth  curves.)  One  branch  of  the 

unstable  manifold  of  p  at  A  »  I.SI**  extends  into  the  white  region, 

1 

as  shown  in  Fig.  2a,  At  the  critical  value  A*  *•  1.31^5,  after  which 

4 

the  basin  boundary  Jumps  into  the  white  region,  we  find  that  W®(p|) 
and  w'^(p^)  are  tangent  (Fig.  2b).  S.  Hammel  and  C.  Jones  CHJ]  were 
the  first  to  prove  a  theorem  relating  the  tangency  of  W®(p^)  and' 
W^(?^)  (called  a  homoclinic  tangency)  to  basin  metamorphoses.  Their 
methods  are  different  from  ours,  however.  We  want  to  relate  these 
metamorphoses  to  the  saddle  periodic  orbits  which  are  found  near  the 
points  of  tangency  and  which  we  describe  below. 

The  complicated  dynamical  behavior  which  occurs  at  homoclinic  tan- 
gencies  has  been  studied  at  length  in  recent  years,  especially  in  the 
papers  of  Gavrilov  and  Silnikov  [GS],  Newhouse  [N],  and  Robinson  [R]. 
Under  certain  non-degeneracy  assumptions,  there  are  horseshoe  maps 
defined  on  subsets  of  the  plane  near  a  point  of  tangency  of  W®(Pi) 
and  W''-*(p^).  Figure  3  shows  a  rectangle  84  and  some  of  its  iterates 
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Figure  2  Caption 

Figures  2a  and  2b  show  the  stable  and  unstable  manifolds  of 
fixed  point  Pj^  before  and  at  tangency,  respectively. 


a 


under  f.  Notice  that  f  (Bj^)  is  horseshoe  shaped  and  intersects 
in  two  components.  In  fact,,  for  h  sufficiently  large,  there  is  a 
rectangle  B^^  near  the  point  of  tangency  .Iq  such  that  f*^  restricted 
to  Bj^  is  a  horseshoe  map.  There  is  necessarily  a  saddle  orbit  of 
period  n  in  each  of  the  two  components  of  the  intersection  of  B^^ 
and  f'^(Bj^)  (see,  for  example,  CR]).  On^  -'f  these  saddles  will  have  a 
"flipped"  unstable  manifold  (i.e.,  at  this  saddle  has  an  eigen¬ 

value  less  than  -1),  and  the  other  will  not.  We  label  the  unflipped 
saddJ!*i  p^.  This  orbit  is  called  a  "simple  Newhouse  periodic  orbit"  in 
[TY]. 

The  larger  n  is,  the  closer  will  be  to  and  W®(p^). 

This  corresponds  to  the  fact  that  the  length  of  time  (i.e.,  the  number 
of  iterates  of  f)  it  takes  for  a  point  I .  move  around  the  fixed  point 
Pj  is  determined  by  how  close  the  point  is  to  the  stable  manifold 
W®(P|).  What  we  see  (Fig.  t»)  is  an  infinite  family  of  horseshoes,  and  a 
sequence  (p^^l  of  simple  Newhouse  saddles  (where  Pj^  has  period  n 
and  is  in  Bj,)  such  that  Ip^)’*’  %•  In  the  following  theorem,  as  stated 
in  CGOY],  the  saddle  fixed  point  S  corresponds  to  p^  in  the  discus¬ 
sion  above,  and  the  saddle  orbit  T  corresponds  to  a  simple  Newhouse 
orbit  Pj^,  for  some  n.  The  terra  "first  non-degenerate  tangency" 
refers  to  the  following  set  (H)  of  hypotheses'. 

(i)  W^(p^)  does  not  intersect  W®(p|)  for  A  <  A*. 

(ii)  There  exist  points  p^  in  W'^(p^)  and  qQ  in  W^(p^) 

such  that  q^  =  f*^(PQ)  for  some  k  ^  1,  at  A  =  A». 

(iii)  There  is  a  parametrization  h^,  -1  <  t  ^  ^ 

near  q^  such  that  h^  =  q^  and  w'^(p^)  near  qQ  is  given  by 
g(h^.),  where  g'(hQ)  =  0  and  g"(hQ)  ^  0. 
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Figure  4  Caption 

Figure  4  shows  the  relative  positions  of  two  simple  Newhouse 
es  p^  and  periods  n  and  n+1,  respectively. 


theorem.  Consider  an  invertible  map  f  of  the  plane  depending  on 
a  parameter  A  with  a  saddle  fixed  point  or  periodic  orbit  S.,  We 
assume  that  the  absolute  value  of  the  determinant  of  the  Jacobian  of 
f  (or  of  f'^  in  the  case  of  a  periodic  orbit  of  period  n)  is  less 
than  one  at  every  point  of  the  plane.  Assume  that,  f  has  a  transition 
value  A*  as  A  increases  where  the  stable  and  unstable  manifolds  of 
S  have  a  non-degenerate  tangency  and  then  cross  for  the  first  time. 

Tnen  there  will  be  a  periodic  saddle  T  that  is  in  the  closure  of  the 
stable  manifold  of  S  for  all  A  slightly  greater  than  S*  but  Is  hot 
in  it  at  A*.  .  • 

We  prove  the  theorem  with  the  aid'  of  the  following  lemmai 

,  *  < 

Leimna.  Let  p,^  be  a  simple  Newhouse  saddle  of  period  k  (as 

described  above)  near  the  point  of  tangjency  of  the  stable  and 

unstable  manifolds  of  p^ .  Then,  for  n  sufficiently  large,  the 

unstable  manifold  of  p^^  crosses  (i.e.,  intersects  transversally)  the 

stable  manifolu  of  P^+i  • 

We  postpone  the  proof  of  this  lemma  due  to  its  technical  nature  and 
proceed  to  show  how  the  theorem  follows.  If  w''^(Pn)  crosses 
at  a  point  x,  then  the  forward  iterates  of  any  segment  of 

containing  x  will  eventually  contain  all  of  closure 

of  W^(Pj^+|),)  in  its  set  of  limit  points^  (see  Fig.  5a).  Hence 

W^(p^^^  )  c  w''^(p^).  Proceeding  inductively,  we  have  that 


^This  follows  from  the  ^-lemma.  See,  for  example,  the  exposition  in 
CGH]. 


5 


Figure  5  Caption 


Figure  5a  indicates  that  the  closure  of  contained 

in  the  closure  of  w'^(p^).  Figure  5b  indicates  that  the  point  of 
tangency  is  in  the  closure  of  the  unstable  manifolds  of  infinity 
many  simple  Newhouse  saddles. 


(i)  H^(p - )  c  H^(p  ),  (see  Fig.  5b),  for  every  m  2  Hi  In  fact, 
as  tbe  proof  of  the  lennna  will  show,  the  horseshoe  f”(Bjj)  contains  a 
segment  of  w'^(Pjj)  around  p^.  As  li.  •i  the  horseshoed  become 
thinner  and  approach  w'^(p|)-  For  A  slightly  larger  than  A*  and 
for  ra  sufficiently  large,  the  horseshoe  F®(Bjjj),  and  hence 
win  cut  across  W^(p^).  thus^ 

(ii)  wl^Cp.)  c  w^^Cp  ). 

1  ni 

Putting  together  (i)  and  (ii),  we  ha ye 

■a 

(iii)  W^'(p^ )  c  w^(p^) ,  foP  n  sufficienly  large.  Notice  that 
although  both  h  Md  m  are  taken  "sufficiently  large"  for  this  argu¬ 
ment,  the  crossing,  of  W^(Pfi)  .ahd  W®(Ph+i )  occurs  for  values  of  n 
much  smaller  than  the  values  of  m  for  which  W^(pjjj)  crosses  W®(p^) 
after  tangehcy-.  Expression  (iii)  is  equivalent  to 

W^(p^)  c  W®(p.^.) 

(see,  for  example,  [GOY]).  Hence  p^^  is  in  the  closure  of  W®(p.|),, 
for  A  >  A*. 

Remarks. 

(!)•  At  A  =  A*,  the  portion  of  the  plane  bounded  by  W^(r^)  from 
Qq  to  p^  and  W^(p.|)  from  p.)  to  is  invariant  under  f.  The 

saddles  are  in  the  interior  of  this  region,  and  hence  each  one  is  a 
positive  distance  from  the  boundary  W®(p^)  of  the  basin  of  infinity. 
For  every  A  slightly  larger  than  A*,  the  theorem  says  that  there  is 


’Again  by  the  X-lemma. 
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an  n  such-  that  *p^  Is  in  the  closure  of  W®(p.^ )  there  is  -a 

junp  In  the  boMdary  at  A  *  A*. 

(2) :  the  condition  that  h  is  sufficiently;  large  here;  refers  .to 
the  value  of  n  for  which  the  sequence  of  crossingslof  wH(pj^)  and 
W®(pn+^)  begins.  For  the  Hehon  map  with  J  =  0.3  and  A*  *1.314,, 
h  appears  to  be-  4;  (see  [GOY]).  Tliis  is  supported  by  computer  evir 
dence  that  for  A  slightly  greater  than  1.3145,  the> saddle  ;p^.  is  oh 
the.  bbundan.y  of  the  basin  of  infinity. 

(3)  Non-degeneracy  has  not  been  proved  for  the  tangehcy  of  -the 
Hehon  map  at  A*  =.1.314.  However,  theor^etically,.  almpst  every  such 
tangency  will  be  ;hbn-degeherate . 

(4) .  The  proof  of  ^the-  theorem  characterizes  the  boundary  after 

tangency  by  showihgrthat  therf>  are,  infinitely  many  saddles,  and  their 

stable  manifolds  contained  in  ,W?(p^,)‘.  The  fact  that  there  is  a  j.ump-  in 

the  boundary  is,,  of  course,,  implied -by  this  characterization.  The 

existence  of  such  a  jump  can  be. -demonstrated  by  a  simpler,  topological 

argument.  Any  path  I  connecting  the  left  and'  right  sides  of  (cC. 

Fig.  4)  extends  through  the  horse  shoe  image  If  f’^(Bj^) 

crosses  B^^^^  (as  shown  in  Fig.  4),  a  portion  of  f'^(i)  connects,  the 

left  and  right  side  of  if,  at  tangehcy  (A  »  A^^),  f^(Bj,)  so 

crosses  Bj„^l  for  all  r,.  r  2  n,  then  UlTlT  contains  q^.  For 

r>n 

A  >  A*,  some  forward  iterate  of  I  will  then  cross  W®'(p^). 

Proof  of  Lemma.  Following  the  construction  of  [R],  [TY]'  (see  also 
[GH;  Sec.  6.6])  we  assume  the  following: 

(i)  DF(pi)  has  eigenvalues  v  and  1  which  satisfy 
0  <  \j  <  1 ,  X  >  1 ,  and  vX  <  1 . 

(ii)  There  exists  a  neighborhood  U  of  p.|  in  which  the  map 
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f  is  linear  up  to  smooth  changes  of  coordinates;  i.e.,  f(x,y)  = 

(Ax,  vy)  for  (x.y)  in  U.  (Here  we  need  an  additional  non-rssonance 
assumption — namely,  that  u  and  \  are  not  integer  multiples  of  each 
other . ) 

(iii)  There  is  a  non-degenerate  tangency  of  W®(p^ )  and  w'^(p^). 
Specifically,  there  exist  points  (Pq.O)  in  w'^Cp-j)  and  (0,qQ)  in 
w2(p^)  such  that  f‘^(pQ,0)  =  (0,qo)  and  W^Cp^ )  and  W^Cp^ )  near 
(0,qQ)  satisfy  (H).  Furthermore,  there  is  a  rectangular  neighbor¬ 
hood  V  =  [Pg"e.  Pq"^^^  **  [0,6]  for  some  e  >  0  and  6  >  0,  such  that 

f’^(x,y)  =  (Yy  +  o(x-p^)^,  q^  -  S(x-?^)), 

for  some  positive  constants  Y,  o,  S,  all  (x,y)  ^  V.  (See  Fig.  6.) 

Now  let  W  -  [0,oe^]  x  [q^-Be,  qQ+6e].  (Notice  that  f'^(pQ±e,0)  = 
(oe^.Qq  ±  Be).)  For  n  sufficiently  large,  f"'^‘^''^(V)  stretches 
across  W.  For  such  n,  let  =  f  ^  ^(V)  fl  W.  Actually,  since 
f-n+k(y)  around  a  lot,  we  let  be  the  connected  component 

of  f“"‘^'^(V)  n  w  which  is  nearest  W^(p,).  Under  hyposthesis  (H),  we 
know  (see  [GH]),  that  f"^  restricted  to  B^^  is  a  !.■  seshoe  map,  in 
the  sense  of  Smale  [S],  Specifically,  we  use  the  following  facts  about 
such  maps: 

(i)  Bj^  and  f'’(B^)  intersect  in  two  components,  and 

Wo  .  The  saddle  p„  is  contained  in  W,  _  and  is  the  only  fixed 
point  of  f"^  in  W^  Furthermore,  p^j  is  the  only  point  in 
which  stays  in  under  all  forward  and  backward  iterates  of  f^.. 

(ii)  The  only  points  which  stay  in  under  all  forward 

(respectively,  backward)  iterates  of  f*^  are  in  W^(Pj^)  (resp., 
w''‘(Pn)). 
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We  .ar^e  that  the  stable  manifold' of  extends  (yertlcaliy) 

through  Bjj  (see  Fig.  t)  .  tiet,  be  any  horizontal  'segment  in 

It;  is  easily  seen  that  f^'lL^)  is  a  parabola  which  extends  through 

Recursively  i  let  =  f”(Lj^_^,),  0  for  1  =*  1  i2v3,, . ... . 

Then  c  L^_.  i  and  a  sequence  of  nested;  intervals  with 

length! Lj^)  <  ValengthCLj^^l ) .  Hence  (1  Ly  is  one  point,  call  It  z^. 

ISO 

Since  f®(zQ)  is  iri-  for  all  m  >  1,  Zq  must' be  in  W^(Pj^). 

This  argument  shows  that  W^(pjj)  intersects  the  top  and  bottom  of  B^ 
and  first  leaves  B^^  through  these  sides.  A  similar  argument  (using 
iterates  of  f“M  shows  that  w'^(Pj^)  extends  through  the  horseshoe 
f^(B^),  first  leaving  the  horseshoe  through  the  "feet".  (See  Fig.  7). 

In  order  to  prove -that  w'^(Pj^)  intersects  W®(Pj^+^),  we  need  to 
show  that  the  horseshoe  f'’(B^)  containing  W'^(Pj^)  crosses  through 
Bj^^^  (see  Fig;  8).  let  Q  be  the  distance  from  (O.Qq)  to  , 
and  let  P  be  the  distance  from  to  the  vertex  of  the  right 

parabola  boundary  of  f'^(Bj^),  as  shown  in  Fig.  8.  It  is  easily  seen  by 
our  assumptions  on  f  that  Q  =  ^ ’’’'^(Pq-e)  and  P  » 

Tv^“’^(q*+6E) .  We  conclude  that  ^  =•  Xy(-^ - Vxp)*^  0  as  n  ®, 

0  Q  yp^-e  I 

since  Xp  <  1 .  a 


9. 


Figure  7  Caption 

Figure  7  shows  parts  of  the  stable  and  unstable  manifolds  of  the 
simple  Newhouse  saddle  p^. 


Bn+i 


Figure  8  Caption 

figure  8  lUuscraree  defluitlons  used  In  the  proof  of  the  Lenea 
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Abstract 

The  time  delay  embedding  method  provides  a  powerful  tool  for 
the  analysis  of  experimental  data,  including  a  novel  method  for  noise 
reduction.  In  addition,  we  describe  how  the  method  allows  experimen¬ 
talists  to  use  many  of  the  same  techniques  that  have  been  essential 
for  the  analysis  of  nonlinear  systems  of  ordinary  differential  equations 
and  difference  equations. 


1  Introduction 

Numerical  computation  and  computer  graphics  have  been  essential  tools  for 
investigating  the  behavior  of  nonlinear  maps  and  differential  equations.  The 
pioneering  work  of  Lorenz  [24]  was  made  possible  by  numerical  integration 
on  a  computer,  allowing  him  to  take  nearby  pairs  of  initial  conditions  and 
compare  the  trajectories.  Henon  [23]  discovered  the  complex  dynamics  of 
his  celebrated  quadratic  map  with  the  aid  of  a  programmable  calculator.  A 

’Mailing  address:  Center  for  Nonlinear  Dynamics,  Department  of  Physics,  University 
of  Texas,  Austin,  Texas  78712 
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variety  of  classical  and  modem  techniques  has  been  exploited  to  find  periodic 
orbits;  their  stable  and  unstable  manifolds  [20];  basins  of  attraction  [25]; 
fractal  dimension  [26];  and  Lyapunov  exponents  [17,  29,  35].  In  some  cases, 
numerical  methods  can  establish  rigorously  the  existence  of  initial  conditions 
whose  trajectories  have  essentially  the  same  intricate  structure  that  one  sees 
on  a  computer  screen  [11]. 

Unfortunately,  until  now  experimentalists  have  not  been  able  to  apply 
most  of  these  methods  to  the  analysis  of  experimental  data^  since  they  do 
not  in  general  have  explicit  equations  to  model  the  behavior  of  their  appa¬ 
ratus.  In  cases  where  it  is  possible  to  find  accurate  models  of  the  physical 
system,  quantitative  predictions  about  the  behavior  of  actual  experiments 
are  possible  [22].  However,  all  that  is  available  in  a  typical  experiment  is 
the  time  dependent  output  (e.g.  voltage)  from  one  or  more  probes,  which 
is  a  function  of  the  dynamics.  Until  recently,  power  spectra  have  been  the 
principal  method  for  analyzing  such  data.  For  instance,  Fenstermacher  et 
al.  [19]  relied  heavily  on  power  spectra  to  detect  transitions  from  periodic 
to  weakly  turbulent  flow  between  concentric  rotating  cylinders.  However, 
Fourier  analysis  alone  is  inadequate  for  describing  the  dynamics. 

Other  methods  have  been  used  to  analyze  time  series  output  from  dynam¬ 
ical  systems.  For  instance,  Lorenz  [24]  used  next  amplitude  maps  to  describe 
some  features  of  the  dynamics;  that  is,  he  plotted  z„+i  against  where 
z„  is  the  nth  relative  maximum  of  the  third  coordinate  of  the  numerically 
calculated  solution.  Such  maps  are  often  useful,  not  only  for  investigating 
features  of  the  Lorenz  attractor  [30],  but  also  for  instance  in  experiments  on 
intermittency  in  oscillating  chemical  reactions  [28]. 

In  the  past  several  years,  the  so-called  embedding  method  has  come  into 
common  use  as  a  way  of  reconstructing  an  attractor  from  a  time  series  of 
experimental  data.  In  this  approach,  one  supposes  that  the  dynamical  be¬ 
havior  is  governed  by  a  solution  traveling  along  an  attractor^  (which  is  not 
observable  directly).  However,  one  assumes  that  there  is  a  smooth  function 
which  maps  points  on  the  attractor  to  real  numbers  (which  are  the  exper¬ 
imental  measurements).  In  the  embedding  method,  one  generates  a  set  of 
m-dimensional  points  whose  coordinates  are  values  in  the  time  series  sepa¬ 
rated  by  a  constant  delay  [9].  For  example,  when  m  =  3,  the  reconstructed 
attractor  is  the  set  of  points  {z,-  =  (s,-,  s,+t,  5, •+2t)}  where  r  is  the  time  delay. 

^Existing  numerical  methods  require  the  attractor  to  be  low  dimensional. 
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Takens  [32]  has  shown  that  under  suitable  hypotheses,  this  procedure  yields 
a  set  of  points  which  is  equivalent  to  points  on  the  original  attractor. 

The  earliest  applicatioris  of  the  embedding  method  may  be  called  static 
in  that  the  analysis  focuses  on  the  geometric  properties  of  the  set  of  points 
on  the  reconstructed  attractor.  For  exzimple,  phase  portraits  and  Poinczure 
sections  are  used  in  [4]  to  help  determine  the  transition  between  quasiperiodic 
and  chaotic  flow  in  a  Couette-Taylor  experiment.  Another  important  static 
method  is  the  estimation  of  attractor  dimension  from  experimental  data, 
for  which  there  is  a  large  literature  [26].  In  addition,  various  information 
theoretic  notions  can  be  used  to  find  good  choices  of  embedding  dimension 
and  time  delay  [21]. 

Certain  recent  applications  of  the  embedding  method  are  quite  different 
in  nature  and  can  be  called  dynamic  in  that  information  about  the  dynamics 
is  stored  in  the  computer  for  analysis.  With  each  data  vector  x,-,  one  stores 
the  “next”  vector,  for  example,  x,+i  for  some  5  >  0.  This  makes  it  possible 
to  compute  a  linear  approximation  of  the  dynamics  in  a  neighborhood  of  x,, 
assuming  that  there  is  a  low  dimensional  dynamical  system  underlying  the 
data.^  In  particular,  a  linear  approximation  provides  an  estimate  of  the 
Jacobian  of  the  map  at  x,-  [9].  Eckmann  and  Ruelle  [17]  use  linear  maps 
computed  in  this  way  to  integrate  a  set  of  variational  equations  and  find  the 
positive  Lyapunov  exponents.^ 

In  fact,  the  embedding  method  provides  a  powerful  set  of  tools  for  an¬ 
alyzing  the  dynamics,  the  breadth  of  which  may  not  have  been  realized  by 
Eckmann  and  Ruelle.  In  this  paper,  we  discuss  two  novel  applications  that 
are  possible,  specifically: 

•  Noise  reduction.  Since  one  can  approximate  the  dynamics  at  each 
point,  it  becomes  possible  to  identify  and  correct  inaccuracies  in  trajec¬ 
tories  arising  from  errors  in  the  original  time  series.  Numerical  evidence 
suggests  that  the  noise  reduction  procedure  described  below  improves 
the  accuracy  of  other  anciiyses,  such  as  Lyapunov  exponents  and  di¬ 
mension  calculations. 

•  Simplicial  approximations.  Linear  approximations  can  be  com¬ 
puted  at  each  point  on  a  grid  in  a  neighborhood  of  the  attractor  to 

^This  material  was  first  presented  by  D.  Ruelle  at  a  Nobel  symposium  in  June  1984? 

^Wolf  et  al.  [35]  have  proposed  a  different  method  in  which  nearby  pairs  of  points  are 
followed  to  estimate  the  largest  Lyapunov  exponent. 
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form  a  simpiicial  approximation  of  the  dyntunical  system.  This  can  be 
used  to  locate  unstable  periodic  orbits  near  the  attractor. 

We  begin  with  a  description  of  noise  red  xction  in  the  next  section. 


2  Noise  Reduction 

The  ability  to  extract  information  from  time  varying  signals  is  limited  by 
the  presence  of  noise.  Recent  experiments  to  study  the  transition  to  turbu¬ 
lence  in  systems  far  from  equilibrium,  like  those  by  Fenstermacher  et  al.  [19], 
Behringer  and  Ahlers  [1],  and  Libchaber  et  al.  [16],  succeeded  largely  be¬ 
cause  of  instrumentation  that  enabled  them  to  quantify  and  reduce  the  noise. 
However,  it  is  often  expensive  and  time  consuming  to  redesign  experimental 
apparatus  to  improve  the  signal  to  noise  ratio. 

In  cases  where  the  time  series  can  be  viewed  as  a  dynamical  system  with 
a  low  dimensional  attractor,  the  time  delay  embedding  method  can  be  ex¬ 
ploited  to  correct  errors  in  trajectories  that  result  from  noise.  This  is  done 
in  two  steps  once  an  embedding  dimension  m  and  a  time  delay  r  have  been 
fixed.  In  the  first  step,  we  consider  the  motion  of  an  ensemble  of  points  in 
a  small  neighborhood  of  each  point  on  the  attractor  in  order  to  compute  a 
linear  approximation  of  the  dyneimics  there.  In  the  second  step,  we  use  these 
approximations  to  consider  how  well  an  individual  trajectory  obeys  them. 
That  is,  we  ask  how  the  observed  trajectory  can  be  perturbed  slightly  to 
yield  a  new  trajectory  that  satisfies  the  linear  maps  better.  The  trajectory 
adjustment  is  done  in  such  a  way  that  a  new  time  series  is  output  whose 
dynamics  are  more  consistent  with  those  on  the  phase  space  attractor. 

This  approach  is  fundcimentally  different  from  traditional  noise  reduction 
methods.  Because  we  consider  the  motion  of  points  on  a  phase  space  attrac¬ 
tor,  we  are  using  information  in  the  original  signal  that  is  not  localized  in  a 
time  or  frequency  domain.  Points  which  are  close  in  phase  space  correspond 
to  data  which  in  general  are  widely  and  irregularly  spaced  in  time,  due  to  the 
sensitive  dependence  on  initial  conditions  on  chaotic  attractors.  In  contrast, 
Kalman  [3]  and  similar  filters  extunine  data  which  are  closely  spaced  in  time; 
Wiener  [27]  filters  operate  in  the  frequency  domain. 
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3  Eckmann-Ruelle  linearization 


The  discrete  sampling  of  the  original  signal  means  that  the  points  on  the  re¬ 
constructed  attractor  can  be  treated  as  iterates  of  a  nonlinear  map  /  whose 
exact  form  is  unknown.  We  assume  that  /  is  nearly  linecur  in  a  smaJl  neigh¬ 
borhood  of  each  attractor  point  x  and  write 

/(x)  «  Ax-f  b  =  L{x) 

for  some  m  x  m  matrix  A  and  m- vector  b.  (The  matrix  A  is  the  Jacobian 
of  /  at  X.) 

This  approximation,  which  we  call  the  Eckmann-Ruelle  linearization  at 
X,  can  be  computed  with  least  squares  methods  similar  to  those  described 
in  [S,  17].  Given  a  reference  point  Xref,  let  {x,}JLi  be  a  collection  of  the 
n  points  which  are  closest  to  Xref.  With  each  point  x,-  we  store  the  next 
point  (i.e.,  the  image  of  x,),  denoted  y,-."*  The  kih  row  ajt  of  A  and  the  kth 
component  bk  of  b  are  given  by  the  least  squares  solution  of  the  equation 

t/jt  =  6fc -f  a*  •  X,  (1) 

where  yk  is  the  kth.  component  of  y  and  the  dot  denotes  the  dot  product. 
Figure  1  illustrates  the  idea.® 

We  mention  three  difficulties  in  computing  the  local  linear  approximations 
in  the  subsections  below. 


3.1  Ill  conditioned  least  squares 

There  is  a  particular  problem  when  one  tries  to  compute  solutions  to  Eq.  1 
with  a  finite  data  set  of  limited  accuracy  that  has  not  been  addressed  in 
previous  papers  [17,  29).  Suppose  for  example  that  all  the  points  in  a  neigh¬ 
borhood  of  Xref  fie  nearly  along  a  single  line,  i.e.,  the  attractor  appears  one 
dimensional  within  the  available  resolution.  Although  it  is  possible  to  mea¬ 
sure  the  expansion  along  the  unstable  manifold  at  Xref,  there  are  not  enough 

^The  points  x<  are  points  on  the  attractor  which  are  not  consecutive  in  time.  The 
subscript  t  merely  enumerates  all  the  points  on  the  attractor  contained  within  a  small 
distance  c  of  Xref.  In  this  notation,  x,  and  y,-  are  consecutive  in  time. 

®  Farmer  and  Sidorowich  [18]  observe  that  the  Eckmann-Ruelle  linearization  can  be  used 
for  prediction.  Given  a  reference  point  x,-,  find  the  Eckmann-Ruelle  linearization  /l,x+b,-, 
compute  x,+i  =  AiX,  +  b,-,  and  repeat  the  process  to  get  the  predicted  trajectory. 
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Figure  1:  Schematic  diagram  for  the  first  stage  of  the  noise  reduction  method. 
A  collection  of  points  in  an  c-bail  about  the  reference  point  Xref  is  used  to 
find  a  linear  approximation  of  the  dynamics  there. 
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points  in  other  directions  to  measure  the  contraction.  Hence  it  is  not  possi¬ 
ble  to  compute  a  2  x  2  Jacobian  matrix  accurately.  Any  attempt  to  do  so 
will  result  in  an  estimate  of  the  Jacobian  whose  elements  have  large  relative 
errors.  This  kind  of  least  squares  problem  is  ill  conditioned. 

The  ill  conditioning  can  be  avoided  by  changing  coordinates  so  that  the 
first  vector  in  the  new  basis  points  in  the  unstable  direction.®  A  one  dimen¬ 
sional  approximation  of  the  dynamics  is  computed  using  the  new  coordinates; 
that  is,  we  approximate  the  dynamics  only  along  the  unstable  manifold.  We 
recover  the  matrix  A  by  changing  coordinates  back  to  the  original  basis. 

For  example,  if  we  are  working  in  the  plane  and  the  unstable  direction 
is  the  line  y  =  x,  then  we  rotate  the  coordinate  axes  by  45  degrees.  The 
dynamics  are  approximated  by  a  one-dimensional  linear  map  computed  along 
the  line  y  ~  x.  Then  we  rotate  back  to  the  original  coordinates.  (The 
resulting  matrix  A  has  rank  1  in  this  example.)  This  approach  substantially 
enhances  the  robustness  of  the  numerical  procedure, 

3.2  Finding  nearest  neighbors 

A  second  problem  is  finding  an  efficient  way  to  locate  all  of  the  points  closest 
to  a  given  reference  point.  The  dynamical  embedding  method  imposes  strin¬ 
gent  requirements  on  any  nearest-neighbor  algorithm.  The  storage  overhead 
for  the  corresponding  data  structures  must  be  small,  because  there  are  tens 
of  thousands  of  attractor  points.  The  algorithm  must  be  fast,  since  there  is 
one  nearest- neighbor  problem  for  each  linear  map  to  be  computed. 

We  solve  this  problem  by  partitioning  the  phase  space  into  a  grid  of  boxes 
that  is  parallel  to  the  coordinate  axes.  Each  coordinate  axis  is  divided  into 
B  intervals.  (Figure  2  illustrates  the  grid  in  two  dimensions.)  Each  point 
on  the  attractor  is  assigned  a  box  number  according  to  its  coordinates.  For 
example,  a  point  on  the  plane  whose  first  coordinate  falls  in  the  jth  interval 
(counting  from  0)  along  the  x  axis  and  whose  second  coordinate  falls  in  the 
A:th  interved  along  the  y  axis  is  assigned  to  box  number  kB  +  j.  The  list  of 
box  numbers  is  sorted,  carrying  along  a  pointer  to  the  original  data  point. 
Given  a  reference  point  Xref ,  its  box  number  is  found  using  the  above  formula. 
A  binary  search  in  the  list  of  box  numbers  then  locates  the  address  of  Xref 

®This  is  done  by  computing  the  right  singular  vectors  [8)  of  the  n  x  m  matrix  whose 
jth  row  is  Xj . 
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Figure  2:  Box  numbering  scheme  in  2  dimensions.  The  attractor  is  normal¬ 
ized  to  fit  in  the  unit  square.  The  bottom  row  of  boxes  rests  against  the  x 
axis  and  the  leftmost  row  of  boxes  against  the  y  axis. 

and  all  the  other  points  in  the  same  box  number.  The  search  is  extended  if 
necessary  to  adjacent  boxes. 

Only  a  crude  partition  is  needed  for  this  algorithm  to  work  efficiently 
(typically  we  choose  B  =  40),  and  the  grid  is  extended  only  to  the  first 
three  coordinate  axes.  When  the  embeddii.g  dimension  is  larger  than  three," 
a  preliminary  list  of  nearest  neighbors  is  obtained  using  only  the  first  three 
coordinates  of  each  attractor  point.  The  final  list  is  extracted  by  computing 
the  distances  from  Xref  to  each  point  in  the  preliminary  list. 

Although  there  are  circumstances  where  this  algorithm  can  perform  poorly 
(e.g.,  when  most  of  the  attractor  points  are  concentrated  in  a  handful  of 
boxes),  the  distribution  of  points  on  typical  attractors  is  sufficiently  uniform 
that  the  running  time  is  very  fast.  Memory  use  is  also  efficient:  a  set  of  N 
attractor  points  requires  3iV  storage  locations.  In  contrast,  the  tree-search 
algorithm  advocated  in  [18]  requires  several  times  more  storage  (although 
the  lookup  time  is  probably  slightly  less).  Because  N  «  10®  in  typical  appli¬ 
cations,  we  believe  that  the  bo.x-grid  approach  (or  some  variant)  is  Ine  most 
practical.  A  survey  of  other  nearest-neighbor  algorithms  is  given  in  [2]. 

3.3  Errors  in  variables 

There  is  a  potential  difficulty  in  the  use  of  ordinary  least  squares  to  compute 
the  linear  maps.  In  the  usual  statistical  problem  of  fitting  a  straight  line, 
one  has  observations  (xi,^,)  where  Xi  is  known  exactly  and  y,-  is  measured. 
One  assumes  that  y,-  =  Go  +  gjx,-  -f  €,-,  where  the  e,-  are  independent  errors 
drawn  from  the  same  normal  distribution.  (Analogous  assumptions  hold 
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in  the  multivariate  case.)  In  the  present  situation,  however,  both  Xi  and 
yi  are  measured  with  error.  It  cau  be  shown  that  ordinary  least  squares 
produces  biased  estimates  of  the  parcimeters  cq  and  in  this  case  (15, 10].  In 
practice  this  does  not  seem  to  be  a  serious  problem,  but  statistical  procedures 
to  handle  this  situation  (the  so-called  “errors  in  variables”  methods)  may 
provide  an  alternative  approach  to  noise  reduction.  We  consider  this  question 
in  the  appendix. 

4  IVajectory  Adjustment  by  Minimizing  Self 
Inconsistency 

The  Eckmann-Ruelle  linearization  procedure  described  above  is  computed 
and  the  resulting  maps  are  stored  for  a  sequence  of  reference  points  along  a 
given  trajectory  (for  the  results  quoted  here,  the  sequence  usually  contains 
24  Doints).  We  now  consider  how  to  perturb  this  trajectory  so  that  it  is  more 
consistent  with  the  dynamics.  The  objective  is  to  choose  a  new  sequence  of 
points  Xj  to  minimize  the  sum  of  squares 

u?!lx<  -  x,-||*  +  jjxi  ~  i,„i(ic<.i)||*  +  i|Xf+i  -  L,(x,)|p  (2) 

where  L(x,)  =  /IjX,-  -f  b,-,  w  is  a  weighting  factor,  and  the  sum  runs  over 
all  the  points  along  the  trajectory.*  Equation  2  can  be  solved  using  least 
squares.  Heuristically,  Eq.  2  measures  the  self-inconsistency  of  the  data, 
assuming  that  the  linear  approximations  of  the  dynamics  are  accurate.  See 
Fig.  3.  We  say  the  new  sequence  {x,  }  is  more  self  consistent. 

The  trajectory  adjustment  can  be  iterated.  That  is,  once  a  new  trajectory 
Xi  has  been  found,  one  can  replace  each  X{  in  Eq.  2  by  Xi  and  compute  a  new 
sequence  {xi}. 

We  place  an  upper  limit  on  the  distance  a  poiiit  can  move.  Points  which 
seem  to  require  especially  large  adjustments  can  be  flagged  and  output  un¬ 
changed.  (This  may  be  necessary  if  the  input  time  scries  contains  large 

’’In  the  results  described  in  this  paper,  the  Eckmann-Ruelle  linearization  procedure 
is  done  using  a  collection  of  points  within  a  radius  of  1-6%  of  the  each  reference  point, 
depending  on  the  embedding  dimension,  the  dimension  of  the  attractor,  and  the  number 
of  attractor  points.  This  results  in  collections  of  50-200  points  per  ball,  which  gives 
reasonably  accurate  map  approximations  without  making  the  computer  program  too  slow. 
The  weighting  factor  vt  is  set  to  1. 
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Figure  3:  Schematic  diagram  of  the  trajectory  adjustment  procedure.  The 
trajectory  defined  by  the  sequence  {x,}  is  perturbed  to  a  new  trajectory 
given  by  {x<}  which  is  more  consistent  with  the  dynamics.  In  this  example 
the  dashed  line  shows  what  the  perturbed  trajectory  might  look  like  if  the 
dynamics  were  approximately  horizontal  translation  to  the  right. 

“glitches”  or  if  nonlinearities  are  significant  over  small  distances  in  certain 
regions  of  the  attractor.) 

When  the  input  is  a  time  series,  we  modify  the  above  procedure  slightly 
since  we  require  a  time  series  as  output.  The  trajectory  adjustment  is  done  so 
that  changes  to  the  coordinates  of  x,-  (corresponding  to  particuleu:  time  series 
values)  are  made  consistently  for  all  subsequent  points  whose  coordinates 
are  the  same  time  series  values.  For  example,  suppose  the  time  delay  is  1 
and  the  embedding  dimension  is  2.  Then  trajectories  are  perturbed  so  that 
the  second  coordinate  of  the  tth  point  is  the  same  as  the  first  coordinate 
of  the  (*  +  l)st  point.  That  is,  when  x,-  =  (si,s,+i)  is  moved  to  the  point 
Xi  =  (Si^i.+i),  we  require  that  the  first  coordinate  of  x,+i  be  Sf+i. 
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5  Results  using  experimental  data 

We  note  that  the  attractor  need  not  be  chaotic  for  this  noise  reduction  proce¬ 
dure  to  be  effective.  Fig.  4(a)  shows  a  phase  portrait  of  noisy  measurements 
of  wavy  vortex  flow  in  a  Couette-Taylor  experiment  [12].  This  flow  is  peri¬ 
odic,  so  the  attractor  is  a  limit  cycle  (widened  into  a  band  because  of  the 
noise)  and  the  power  spectrum  consists  of  one  fundamental  frequency  and  its 
harmonics  above  a  noise  floor.  See  Fig.  4(6).  Figures  4(c)-(d)  show  the  same 
data  after  noise  reduction.  The  noise  reduction  procedure  makes  the  limit 
cycle  much  narrower,  and  the  noise  floor  in  the  power  spectrum  is  reduced 
by  almost  two  orders  of  magnitude.  However,  no  power  is  subtracted  from 
any  of  the  fundamental  frequencies,  and  in  fact  some  harmonics  are  revealed 
which  previously  were  obscured  by  the  noise. 

These  results  are  significantly  different  from  those  obtained  by  low  pass 
filtering.  Figure  4(c)-(/)  shows  the  phase  portrait  and  power  spectrum  when 
the  original  data  are  passed  through  a  12th-order  Butterworth  filter  with  a 
cutoff  frequency  of  0.35.  Th<-  dynamical  noise  reduction  procedure  is  more 
effective  than  low  pass  filtering  since  the  noise  appears  to  have  a  broad  spec¬ 
trum. 

However,  the  method  appea^to  subtract  power  from  a  mode  whose  fun¬ 
damental  frequency  is  approximately  0.3  times  the  Nyquist  frequency.  We 
do  not  know  exactly  why  this  occurs.  However,  this  peak  corresponds  to 
the  rotation  frequency  of  the  inner  cylinder  and  may  result  from  a  defect  in 
the  Couette-Taylor  appjuratus  [31].  We  do  not  consider  this  to  be  a  serious 
problem,  because  the  power  associated  with  this  mode  is  several  orders  of 
magnitude  smaller  than  that  of  the  wavy  vortex  flow. 

We  emphasize  that  our  objective  is  to  find  a  simple  dynamical  system 
that  is  consistent  with  the  data.  It  is  possible  for  this  method  to  eliminate 
certain  dynamical  behavior  from  an  attractor  if  those  dynamics  have  small 
amplitude.  This  situation  is  most  likely  to  arise  when  there  are  not  enough 
data  to  distinguish  such  dynamics  from  random  noise.  In  the  present  ex¬ 
ample,  the  noise  reduction  procedure  reveals  the  limit  cycle  behavior  quite 
well.® 

The  results  obtained  by  applying  the  method  to  chaotic  data  from  the 

^We  have  not  attempted  to  find  the  smallest  amplitude  at  which  the  noise  reduction 
procedure  can  distinguish  quasiperiodic  from  periodic  flow. 
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Figure  4:  Phase  portraits  and  power  spectra  for  measurements  of  wavy  vor¬ 
tex  flow  in  a  Couette-Taylor  experiment.  (a)-{6)  Phase  portrait  and  power 
spectrum  before  noise  reduction  is  applied;  (c)-(d)  after  noise  reduction;  (e)- 
(/)  after  a  low  pass  filter  is  applied  to  che  original  data.  The  vertical  axis  in 
(6),  (d)  and  (/)  is  the  base-10  logarithm  of  the  power  spectral  density;  the 
horizontal  axis  is  in  multiples  of  the  Nyquist  frequency. 
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Couette-Taylor  fluid  flow  experiment  described  in  [4]  are  shown  in  Fig.  5. 
Figure  5(a)  shows  a  two  dimensional  phase  portrait  of  the  raw  time  series  at  a 
Reynolds  number  R/jRc  =  12.9,  which  corresponds  to  weakly  chaotic  flow  [4]. 
The  corresponding  phase  portrait  from  the  filtered  time  series  is  shown  in 
Fig.  5(6).  Figs.  5(c)-(d)  show  the  power  spectra  for  the  corresponding  time 
series.® 

It  is  difficult  to  estimate  how  much  noise  is  removed  from  the  data  in  this 
example  on  the  basis  of  power  spectra.  One  problem  is  that  the  transition 
from  quasiperiodic  to  weakly  chaotic  fluid  flow  is  marked  by  a  sudden  rise  in 
the  noise  floor  in  the  power  spectrum  (cf.  Fig.  3  in  [4]).  Hence  one  cannot 
determine  how  much  of  the  noise  floor  is  due  to  deterministic  chaos  and  how 
much  results  from  broadband  noise.  The  noise  reduction  procedure  described 
here  has  the  effect  of  reducing  the  power  in  the  high  frequency  components 
of  the  signal.  One  question  therefore  is  whether  reducing  the  high-frequency 
noise  corresponds  to  discovering  the  true  dynamics  which  have  been  masked 
by  noise.  We  believe  that  the  answer  is  yes,  based  on  those  cases  where  there 
is  an  underlying  low-dimensional  dynamical  system.  However,  in  chaotic  pro¬ 
cesses  some  high-frequency  components  remain,  because  they  are  appropriate 
to  the  dynamics. 

6  Numerical  Experiments  on  Noise  Reduc¬ 
tion 

One  important  question  is  how  much  noise  this  method  removes  from  the 
data.  The  power  spectra  above  suggest  that  the  method  eliminates  most  of 
the  noise,  but  it  is  impossible  to  give  a  precise  estimate  for  typical  experi¬ 
mental  data. 

However,  the  Henon  map  [23]  provides  a  convenient  way  to  quantify  the 
noise  reduction,  because  it  can  be  written  as  a  time  delay  map  of  the  form 

®»+i  =  fixuxi.i)  =  1  -  ai-  -f  (3) 

We  use  Eq.  3  to  generate  a  time  series  as  follows  (with  the  standard  parameter 
vzdues  Q  =  1.4,  /3  =  0.3).  We  choose  an  initial  condition  and  discard  the 

®The  time  series  consists  of  32,768  values,  from  which  an  attractor  is  reconstructed  in 
four  dimensions.  Linear  maps  ate  computed  using  50-100  points  in  each  ball.  Trajectories 
ate  fitted  using  sequences  of  24  points. 
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Figure  5:  Phase  portraits  and  power  spectra  for  measurements  of  weakly 
chaotic  flow  in  a  Couette-Taylor  experiment.  (a)-(^>)  Phase  portrait  and 
power  spectrum  before  noise  reduction  is  applied;  (c)-(d)  after  noise  reduc¬ 
tion.  The  units  for  the  power  spectrum  plots  are  the  same  as  those  in  [4|. 
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first  100  iterates.  The  next  32,768  iterates  are  stored,  and  a  time  series  is 
generated  by  adding  a  uniformly  distributed  random  number  to  each  iterate. 
This  simulates  a  time  series  with  measurement  noises  i.e.,  a  time  seri(;s  where 
noise  results  from  errors  in  measuring  the  signal,  not  from  perturbations  of 
the  dynamics. 

We  measure  the  improvement  in  the  signal  sdter  processing  by  considering 
the  pointwise  error  e,-  =  —  /(zj,  i.e.,  the  distance  between  the  ob¬ 

served  image  and  the  predicted  one.  Let  the  mean  error  he  E  =  eflNY^^, 
the  rms  value  of  the  pointwise  error  over  all  N  points  on  the  attractor.  We 
define  the  noise  reduction  as  R=  I  —  Eistted/ ^noisy»  where  the  mean  errors  are 
computed  for  the  adjusted  and  original  noisy  time  series,  respectively.  The 
quantity  H  is  a  measure  of  the  self-consistency  of  the  time  series.  (In  other 
words,  R  measures  how  much  better  on  the  average  the  output  attractor 
obeys  Eq.  3  as  one  hops  from  point  to  point.) 

When  1%  noise  is  added  to  the  input  as  described  above,  the  noise 
reduction  (measured  with  the  actual  map)  is  79%.^°  Nearly  identical  re¬ 
sults  are  obtained  wnen  the  input  contains  only  0,1%  noise.  In  addition, 
noise  levels  can  be  reduced  almost  as  much  in  cases  where  the  noise  is 
added  to  the  dynamics,  i.e,,  where  the  input  is  of  the  form  = 

f(xi  +  +  Vi-i)t  ViiVi-i  random}.  When  the  program  is  run  on  noise¬ 

less  input,  the  mean  error  in  the  output  is  0.025%  of  the  attractor  extent, 
which  suggests  that  errors  arising  from  small  nonlineiirities  are  negligible 
when  the  input  contains  enough  points. 


7  Simplicial  Approximations  of  Dynamical 
Systems 

Recent  work  has  shown  that  simplicial  approximations  of  dynamical  systems 
can  reproduce  the  behavior  of  the  original  system  to  high  accuracy  [34].  (See 
also  [33]  for  a  bilineair  approach.)  In  particular,  the  fractal  structure  of  the 
original  attractors  and  basin  boundaries  is  preserved  over  meiny  scales.  Such 
approximations  can  yield  significant  computational  savings,  especially  when 
the  origincd  system  consists  of  ordinary  differential  equations. 

^°The  pointwise  error  is  measured  using  Eq.  3.  However,  the  attractor  can  oe  embedded 
in  more  than  two  dimensions  when  performing  the  noise  reduction. 
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This  approach  can  be  extended  in  a  natural  way  to  generate  simplicial 
approximations  of  the  dynamics  on  attractors  reconstructed  from  experimen¬ 
tal  data.  Our  objective  here  is  to  find  an  approximate  dynamical  system  in 
a  neighborhood  of  the  attractor  as  follows. 

A  simplex  in  an  m  dimensional  space  is  a  triangle  with  m  1  vertices. 
Suppose  the  map  is  known  at  each  point  on  a  grid.  Then  there  is  a  unique  way 
to  extend  the  map  linearly  to  the  interior  of  the  simplex  S  whose  vertices 
are  grid  points.  Given  a  point  P  in  the  interior  of  5,  let 
corresponding  barycentric  coordinates  (see  [34]  for  an  algorithm  to  compute 
them).  Let  f(v{)  be  the  map  at  the  ith  vertex.  The  dynamical  system  at  P 
is  iterated  by  computing 


m 

We  apply  this  method  to  experimental  data  by  finding  a  linear  approx¬ 
imation  of  lue  dynamics  at  each  vertex  u,-  with  the  least  squcires  method 
described  above,  using  a  collection  of  points  in  a  small  ball  around  u,.  The 
maps  are  stored  and  retrieved  using  a  hashing  algorithm  similar  to  that  de¬ 
scribed  in  [34].  This  yields  a  piecewise  linear  approximation  of  the  dynamics 
from  a  set  of  experimental  data  which  can  be  analyzed  with  the  methods 
that  previously  were  available  only  to  theorists.^^ 

We  illustrate  the  approach  using  a  time  series  of  32,768  values  from  the 
Henon  map  with  a  =  1.2,  =  0.3  using  Eq.  3  and  adding  0.1%  noise  as 

described  above.  The  original  attractor  is  shown  in  Fig.  6(a).  We  take  a  grid 
of  points  which  are  spaced  at  1%  intervals  (this  and  subsequent  distances  are 
expressed  as  a  fraction  of  the  original  attractor  extent).  The  time  series  is 
embedded  in  two  dimensions,  and  a  linear  approximation  of  the  dynamics  is 
computed  at  each  grid  point  for  which  50  or  more  attractor  points  can  be 
collected  with  a  ball  of  radius  0.03;  the  set  of  such  grid  points  is  shown  in 
Fig.  6(6).  We  take  an  initial  condition  near  the  original  attractor  and  show 
the  first  3000  iterates  using  Eq.  4  in  Fig.  6(c).  Although  some  defects  are 
visible,  the  attractor  produced  by  the  approximate  dynamiccd  system  looks 
cdmost  identical  to  the  origind  one. 

"This  approach  is  le?g  ambitious  than  that  of  Crutchfield  aind  McNamara  [7],  who 
attempt  to  find  a  single  set  of  nonlinear  difference  equations  that  creates  the  observed 
attractor. 
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Figure  6:  (a)  Henon  attractor  computed  from  Eq.  3  with  a  —  1-2,  0  —  0.3. 
(6)  1%  grid  on  which  linear  approximations  of  the  dynamics  are  computed 
from  the  available  attractor  points,  (c)  Attractor  produced  by  the  simplicial 
approximations. 


period 

D  =  2 

exact 

D  =  Z 

1.793 

1.695 

1.757 

2.178 

2.199 

2.183 

4.226 

4.329 

4.051 

10.38 

10.70 

9.626 

10.38 

11.32 

12.12 

8 

25.80 

24.88 

30.25 

8 

20.02 

20.60 

20.38 

8 

17.70 

24.32 

21.70 

Table  1.  The  largest  eigenvalues  of  the  Jacobian  of  the  periodic  orbits  located 
using  the  simplicial  approximation  of  the  Henon  attractor. 


One  application  of  simplicial  approximations  is  the  location  of  periodic 
saddles  and  the  estimation  of  the  largest  eigenvalue  of  the  corresponding 
Jacobian.  That  is,  if  x  is  a  periodic  point  of  period  p,  then  we  find  the 
eigenvr’  e  of  Dp{x)  of  largest  modulus,  where  Dp{x)  refers  to  the  matrix 
of  partial  derivatives  of  the  pth  iterate  of  the  map  /  evaluated  at  x. 

Given  an  initial  guess  for  x,  one  can  apply  Newton’s  method  using  the 
maps  computed  at  the  grid  points  and  Eq.  4  to  locate  the’ saddle  using  the 
simplicial  approximations.  Likewise,  Eq.  3  can  be  used  to  locate  the  corre¬ 
sponding  '‘exact”  saddle.  Saddle  orbits  up  to  period  8  have  been  computed 
in  this  way.  In  all  cases,  the  saddle  point  for  the  simplicial  approximation 
is  within  2%  of  the  corresponding  saddle  point  for  the  Henon  map.  Table 
1  shows  the  largest  eigenvalues  of  the  saddle  orbits.  (The  columns  labeled 
m  =  2  and  m  =  3  refer  to  the  embedding  dimension  used  to  reconstruct  the 
attractor.)  In  most  cases,  the  relative  error  is  only  a  few  percent,  and  in 
no  case  exceeds  25%.  (The  largest  relative  error  is  for  the  period  8  saddles, 
where  one  finds  the  eigenvalue  of  the  product  of  8  Jacobians  computed  from 
the  least  squares.) 

This  method  can  be  extended  to  experimented  data  sets.  However,  there 
are  relatively  stringent  requirements  on  the  data  that  can  be  handled:  the 
time  series  must  be  long  enough  to  trace  out  many  trajectories  near  the  prin¬ 
cipal  unstable  saddle  orbits,  and  the  noise  level  must  be  low.  (Presumably 
noisy  data  can  be  preprocessed  using  the  approach  described  in  Section  3.) 
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The  current  computer  implementation  uses  a  large  amount  of  disk  space  to 
store  the  linear  map  approximations  at  the  grid  points. 

We  have  constructed  a  simplicial  approximation  for  an  attractor  obtained 
from  a  Belousov-Zhabotinskii  chemical  reaction  [6,  28],  The  attractor  is  re¬ 
constructed  in  three  dimensions  from  a  set  of  32,768  measurements  of  bro¬ 
mide  ion  concentration.  The  phase  portrait  is  shown  in  7(a). 

Linear  approximations  of  the  dynamics  are  computed  at  each  point  of  a 
grid  consisting  of  50  intervals  along  each  coordinate  axis  for  which  50  or  more 
attractor  points  can  be  located  within  an  8%  radius  of  the  grid  point.  This 
produces  a  database  of  59,550  maps.  We  observe  from  graphical  evidence 
that  many  trajectories  approach  what  appears  to  be  a  period  3  saddle  in  the 
middle  of  the  attractor.  Using  initial  guesses  from  some  of  the  trajectories, 
we  apply  Newton’s  method  to  locate  the  saddle  orbit  shown  in  Fig.  7(b). 
Moreover,  we  obtain  estimates  of  the  Jacobian  DF  of  the  map  evaluated  ac 
a  point  on  saddle  orbit.  The  eigenvalues  of  DF  are  estimated  as  Ai  =  1.14, 
Aj  =  0.102,  and  A3  =  -1.53.  These  quantitative  results  confirm  that  the 
orbit  is  a  saddle  since  Ai  >  0  >  A3.  (Note  that  one  expects  Aj  =  0  for  a  how 
generated  from  a  set  of  differential  equations.) 

8  Conclusion 

Methods  for  approximating  the  dynamics  of  attractors  reconstructed  from 
experimental  data  provide  powerful  tools.  Most  of  the  same  procedures  that 
have  been  so  important  for  theoretical  insight,  such  as  Poincare  maps,  un¬ 
stable  fixed  points  and  their  manifolds,  basin  boundaries,  and  the  like,  are 
now  available  to  experimenters,  at  least  in  cases  where  the  dynamics  are  low 
dimensional.  There  is  little  doubt  that  these  tools  will  lead  to  breedcthroughs 
in  the  understanding  of  a  wide  variety  of  physical  systems.  However,  con¬ 
siderable  effort  is  needed  before  we  learn  which  kinds  of  systems  will  benefit 
most  from  these  types  of  analyses.  Significant  improvements  in  technique 
will  certainly  extend  the  applicability  of  dynamical  embedding  methods,  for 
example  to  higher  dimensional  attractors. 
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Figure  7:  (a)  The  attractor  reconstructed  from  a  time  series  of  bromide  ion 
concentrations  in  a  Belousov-Zhabotinskii  chemical  reaction,  (b)  The  period 
3  saddle  orbit. 


Appendix 

In  this  appendix  we  outline  a  possible  alternative  noise  reduction  method 
based  on  the  theory  of  least  squares  when  ail  the  quantities  in  the  regression 
are  measured  with  error. 

In  ordinary  least  squares,  the  variables  in  the  problem  fall  into  two  classes: 
the  independent  variables^  which  are  known  exactly,  and  the  dependent  vari¬ 
ables,  which  are  observations  assumed  to  be  functions  of  the  independent 
variables.  The  dependent  variables  are  subject  to  random  errors  that  are 
assumed  independent  and  identically  distributed  (i.i.d.). 

On  an  attractor  reconstructed  from  experimental  data,  we  assume  that 
the  mapping  which  taices  points  in  a  sufficiently  small  ball  to  their  images 
is  approximately  linear.  However,  the  locations  of  all  the  points  are  subject 
to  small  random  errors  because  of  the  noise.  Hence  one  cannot  describe  the 
points  as  independent  variables  and  their  images  as  dependent  variables.  The 
usual  least  squa’-es  method  produces  a  biased  estimate  of  the  linear  map,  and 
this  bias  does  not  decrease  if  more  observations  are  added  [15,  10]. 

The  so-called  “errors  in  variables”  least  squares  methods  can  be  used  to 
handle  the  latter  problem.  This  approach  can  be  used  to  obtain  both  an 
estimate  of  the  linear  map  as  well  as  estimates  of  the  “true”  values  of  each 
of  the  observations. 

At  first  this  appears  to  be  an  underdetermined  problem:  from  n  pairs 
of  observations  one  wants  to  compute  the  parameters  of  the  functional  re¬ 
lation  between  them  as  well  as  estimates  of  the  n  actual  pairs. However, 
it  is  possible  to  solve  this  problem  by  making  some  assumptions  about  the 
errors  [15,  10). 

In  our  case,  we  assume  that  the  errors  in  the  location  of  each  point  and 
its  image  are  i.i.d.  In  particular,  we  let  the  covariance  matrix  of  the  errors 
in  the  variables  be  the  identity  matrix.  This  assumption  is  valid  whenever 
the  noise  is  independent  of  the  dynamics.'^ 

We  illustrate  the  procedure  for  the  case  vffiere  we  are  given  a  collection 
of  n  points  (in  R”*)  and  their  images.  Following  Jefferys  [13],  we  form  a  set 

the  statistical  literature,  the  problem  is  said  to  be  unideatiited. 

‘^Dynamical  noise  (i.e.,  each  point  is  perturbed  slightly  before  iterating)  yields  a  co- 
variance  matrix  which  depends  on  the  point.  However,  as  long  as  the  dynamical  noise  is 
small,  our  assumptions  about  the  covariance  matrix  of  the  errors  should  not  compromise 
the  accuracy  of  the  method. 
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of  n  equations  of  condition  given  by 


fi(x<)  =  Xn+i  -  Axi  -  b,-  =  Xn+i  -  L{Xi)  (5) 

where  x,-  is  the  I'th  point,  Xn+,-  is  its  observed  image,  /I  is  an  m  x  m  matrix, 
and  b  is  an  m-vector.  The  goal  is  to  find  estimates  of  L  (i.e.,  A  and  6), 
together  with  perturbations  v,  such  that 


+  v.)  =  (Xn+l  +  Vn+i)  -  L(x,-  +  V,)  =  0 


and  such  that  the  quadratic  form 

5o  =  (6) 

is  minimized.  The  superscript  t  denotes  transpose  and  a  is  the  covariance 
matrix  of  the  observations  (which  we  assume  is  the  identity  matrix  here). 

Th*i  minimization  problem  can  be  solved  using  Lagrange  multipliets 
(see  (13]  and  (14)  for  a  numerical  algorithm).  The  solution  gives  A  and  h  to¬ 
gether  with  estimates  x,-  -b  v,-  of  the  “true”  observations.  It  can  be  shown  [10] 
under  fairly  mild  hypotheses  that  the  estimates  of  L  and  the  observations 
are  the  best  in  the  class  of  linear  estimators. 

One  way  to  approach  noise  reduction  is  to  extend  Eq.  5  to  include  several 
iterations  of  the  observed  points.  Given  a  collection  of  points  in  a  ball, 
together  with  the  next  p  iterates  of  each  point,  the  method  above  is  used  to 
find  a  collection  of  linear  maps  L\,  Lj,  •  •  •,  Lp  approximating  the  dynamics. 
The  method  also  finds  estimates  of  the  actual  observations.  In  this  approach, 
therefore,  the  calculation  of  the  maps  and  the  adjustmenc  of  the  trajectories 
is  done  in  one  step.  Moreover,  each  point  and  its  image  exactly  satisfy  a 
linear  relationship. 

Of  course,  p  cannot  be  too  large,  because  nonlinear  effects  eventually  will 
become  significant  when  the  dynamics  are  chaotic.  On  the  other  hand,  Eq.  5 
provides  a  natural  way  to  include  quadratic  or  other  nonlinear  terms. 

We  have  written  a  computer  program  to  implement  this  alternative  noise 
reduction  algorithm.  So  far,  the  results  of  this  approach  have  not  been  as 
good  as  those  from  the  method  described  in  the  main  part  of  the  paper,  but 
further  refinement  should  improve  them. 
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ABSTRACT 


For  a  homeomorphism  of  the  plane,  the  basin  of  attraction  of  a 
fixed  point  attractor  is  open,  connected,  and  simply-connected,  and 
hence  is  homeomorphic  to  an  open  disk.  The  basin  boundary,  however, 
need  not  be  homeomorphic  to  a  circle.  When  it  is  not,  it  can  contain 
periodic  orbits  of  infinitely  many  different  periods. 

Certain  points  on  the  basin  boundary  are  distinguished  by  being 
accessible  (by  a  path)  from  the  interior  of  the  basin.  For  an 
orientation-preserving  homeomorphism,  the  accessible  boundc.rv  points 
have  a  well-defined  rotation  number.  We  prove  that  this  rotation  number 
is  rational  if  and  only  if  there  are  accessible  periodic  orbits.  In 
particular,  if  the  rotation  number  is  the  reduced  fraction  p/q,  then 
every  accessible  periodic  orbit  has  minimum  period  q.  In  addition,  if 
the  periodic  orbits  are  hyperbolic,  then  every  accessible  point  is  on 
the  stable  manifold  of  an  accessible  periodic  point. 


1.  Introduction  and  Statement  of  Main  Theorems 


When  a  dynamical  system  has  more  than  one  attractor,  the 
boundaries  between  respective  basins  of  attraction  can  exhibit  very 
complicated  patterns.  For  invertible  maps  of  the  plane,  these 
boundaries  can  be  smooth  or  fractal,  and  they  can  contain  infinitely 
many  saddle-type  periodic  orbits.  (By  fractal,  we  mean  that  the  set 
has  non-integer  Hausdorff  dimension. )  Two  basins  of  attraction  of  the 
time  2ti  map  of  the  forced  damped  pendulum  equation  are  shown  in  black 
and  white  in  Figure  1.  This  picture  was  constructed  by  choosing  a 
960  X  520  grid  and,  using  each  grid  point  as  an  initial  condition, 
testing  where  its  trajectv  y  goes.  The  system  has  two  fixed  point 
attractors — one  in  the  white  region  to  which  ail  grid  points  colored 
white  tend  under  iteration  by  the  map,  and  one  in  the  black  region  to 
which  all  grid  points  colored  black  tend.  The  boundary  between  the 
black  and  white  basins  is  fractal,  making  final  state  predictability 
very  difficult.  In  addition,  buried  within  the  fractal  layers  of  the 
boundary  are  saddle  periodic  orbits  of  arbitrarily  high  periods. 

Even  though  the  dynamics  on  the  boundary  appear  to  be  very 
complicated,  it  has  been  observed  (see,  for  example,  [GOYH  that  some 
points  on  the  boundary  exhibit  regular  behavior.  We  say  that  a  point 
p  on  the  boundary  of  an  open  set  W  is  accessible  from  W  if  there  is  a 
path  beginning  in  W  such  that  p  is  the  first  boundary  point  which 
the  path  hits.  Surprisingly,  when  the  boundary  is  fractal,  most 
points  are  not  accessible.  For  the  map  in  Fig.  1,  ther:  are  two 
points  that  are  saddles  of  period  two  (i.e. ,  one  period  two  orbit) 


which  are  accessible  from  the  white  region,  and  all  other  points  which 
are  accessible  from  the  white  region  are  on  the  stable  manifold  of 
this  periodic  orbit.  In  this  paper,  we  investigate  the  dynamics  of 
the  accessible  points  on  basin  boundaries.  The  paper  is  strongly 
motivated  by  numerical  studies  that  repeatedly  conclude  there  are 
accessible  periodic  saddles  in  the  botindary.  In  fact,  we  know  of  no 
natural  case  of  sui  area-contracting  diffeomorphism  having  a  basin 
boundary  without  acoessible  periodic  orbits. 

We  would  like  to  thank  J.  Mather  and  H.  Nusse  for  helpful 
discussions. 


Throughout  this  paper,  W  is  a  connected,  simply-connected  open 
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set  either  in  the  plane  R  or  in  the  sphere  S  ,  and  F  is  a 
homeomorphism  (or  diffeomorphism,  if  differentiability  is  required)  of 
the  plane  or  the  sphere.  We  assimie  that  W  is  invariant  under  F, 
(i.e. ,  F(W)  =  W),  Our  main  examples  of  such  sets  will  be  basins  of 
attraction.  In  particular,  the  basin  of  attraction  of  an  attracting 
fixed  point  must  be  such  a  set.  (See  Sec.  2. )  We  assume  in  addition 
that  W  is  not  the  entire  plane,  in  which  case  its  boundary  3W  is 
more  than  one  point.  ftfKUir9--a~-connoctgBU.-eet.  Since  W  is  invariant 
under  F,  dU  is  also  an  invariant  set.  All  connected, 
simply-connected  open  sets  are  homeomorphic  to  an  open  disk.  On  the 
other  hand,  the  boundary  of  such  a  region  does  not  have  to  be 
topologically  a  circle,  and  examples  abound  in  which  the  boundary  of  a 


basin  of  attraction  is  a  fractal  set.  The  characterization  of  a  set  W 


as  a  topological  open  disk  occurs  in  the  study  of  the  Riemann  Mapping 
Theorem  which  says  that  for  any  such  set  W  there  is  always  a 
one-to-one  analytic  map  h  of  ein  open  disk  D  onto  W,  The 
knowledge  that  the  basin  is  topologically  an  open  disk  tells  us 
nothing  about  the  boundary  of  a  basin,  and  it  is  our  objective  to 
describe  the  dynamics  on  the  points  in  dW  that  are  accessible  from  W. 

In  the  following  we  say  that  p  is  accessible  only  if  it  is  a 
point  of  aw  that  is  accessible  from  W. 

Caratheodory  [C]  investigated  the  behavior  of  the  map  h  in  the 
Riemann  mapping  theorem  to  see  when  h  could  be  defined  at  boundary 
points  of  the  disk.  If  f  is  a  (continuous)  pa^’h  in  W  which  limits 
on  the  accessible  point  p,  then  h~^(r)  is  a  (continuous)  path  in  D 
limiting  on  exactly  one  point  r  in  S^,  the  boundary  of  D.  We  call 
such  points  as  r  trivial  circle  points:  we  call  all  other  points  on 
the  circle  non-trivial  circle  points.  Caratheodory’ s  approach  was  to 
construct  a  compactif ication  of  W  which  is  topologically  identical  to 
D,  the  closed  disk.  (His  is  not  the  standard  compactif ication; 
points  in  this  compactif ication  which  correspond  to  points  in  the 
boundary  of  D  are  called  "prime  ends"  and  are  defined  precisely  in 
Sec.  5. ) 

We  define  a  map  h  on  points  in  D  and  on  those  points  in  D  that 
c 

are  trivial  circle  points  by  h^(x)  =  h(x)  for  x  in  D,  and  h^(r)  =  P 
where  p  is  an  accessible  point  and  r  is  an  associated  trivial  circle 
point,  as  defined  above.  It  is  clear  from  the  construction  that  each 
accessible  point  is  the  image  of  at  least  one  trivial  circle  point. 
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The  map  h  is  not  necessarily  one-to-one  on  trivial  circle  points, 
o 

(See  Sec.  7;  in  particular,  see  Fig.  7. )  However,  once  a  path  f  in  W 
limiting  on  an  accessible  point  p  is  specified,  then  there  is  exactly 
one  trivial  circle  point  x  which  is  the  limit  of  h  ^(D  . 

We  mention  two  properties  of  accessible  points  and  the  map  h^: 

Property  1  (Density)  The  set  of  accessible  points  is  dense  in  5W; 
the  set  of  trivial  circle  points  is  dense  in  S^,  the  boundary  of  D. 

Property  2  (Existence  of  an  Induced  Map)  There  is  a  map,  denoted 

f  and  called  the  induced  map,  from  D  to  itself  such  that 

h  (f(x))  =  F(h  (x))  when  x  is  in  D  or  x  is  a  trivial  circle  point, 
c  c 


If  p  is  an  accessible  point  and  F  is  a  path  in  W  ending  at  p, 
then  F(r)  is  a  path  in  W  ending  at  F(p).  Hence,  accessible  points  map 
to  accessibie  points.  If  follows  that  f  maps  trivial  circle  points  to 
trivial  circle  points.  On  the  set  of  trivial  circle  points,  f  is 
one-to-one,  onto,  and  order-preserving.  Such  a  map  can  be  uniquely 
extended  to  a  homeomorphism  defined  on  all  of  S^ 

These  properties  allow  us  to  study  the  dynamical  system  on  the 
closed  disk,  maintaining  the  dynamics  on  the  accessible  points.  Since 
in  general  SW  will  include  much  more  than  the  accessible  points,  much 
of  5W  is  lost  in  this  representation.  For  us,  however,  the 
simplification  is  advantageous  since  we  wish  to  describe  the  dynamics 
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on  the  accessible  points. 


We  have  important  examples  in  which  W  is  not  a  basin  even  though 

a  dense  set  of  points  in  W  have  trajectories  tending  to  an  attractor. 

The  following  definition  allows  the  inclusion  of  such  examples.  We 

say  that  3W  is  unstable  iji  W  if  there  is  a  neighborhood  of  9W  with 

the  property  that  the  set  of  points  in  whose  orbits  eventually 

leave  is  dense  in  B^  p)  W.  (I.e. ,  there  is  a  dense  set  Q  in 

B^  Q  W  such  that  xeQ  implies  that  F^(x)  is  in  for  sofne 

n>0.  )  This  definition  is  easily  seen  to  be  satisfied  when  W  is  a 

basin  of  attraction.  It  is  also  satisfied  in  the  very  different  case 

where  there  is  a  dense  orbit  in  W. 

Certain  types  of  periodic  orbits  in  merit  particular 

attention.  Let  p  e  be  a  periodic  point  of  period  k.  We  say  p  is 

attracting  on  at  least  one  side  (of  sM  if  there  exists  x  6  such 

nlc 

that  X  *  p  and  lim  f  (x)  =  p. 

n-)« 

The  following  key  theorem  is  proved  in  Sec.  5: 

Theorem  1.1  (Attracting  Lemma).  Assume  that  aw  unstable  in  w  and 

that  for  each  k  the  fixed  points  of  F  are  isolated.  Then  each 
periodic  circle  point  that  is  attracting  on  at  least  one  side  is  a 
trivial  circle  point. 


An  orientation  preserving  homeomorphism  of  the  circle  can  be 
classified  according  to  its  rotation  number — a  number  p,  with 
0  ip  <1,  which  represents  the  average  rotation  of  points  under  the 
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map.  (A  precise  definition  is  given  in  Sec.  5. )  The  rotation  number 
is  independent  of  the  choice  of  point  on  s\  The  idea  of  associating 
a  single  rotation  number  with  each  orientation  preserving 
homeomorphism  of  the  circle  originated  with  Poincare.  Such  a 
homeomorphism  will  have  a  periodic  point  if  and  only  if  its  rotation 
number  is  rational.  It  will  have  a  fixed  point  if  and  only  if  its 
rotation  number  is  0.  We  define  the  rotation  number  p(3W,F)  of  F  on 
the  accessible  points  of  3W  to  be  the  rotation  number  of  the  induced 
map  f  on  S  .  If  W  is  a  connected,  simply-connected  open  set  in  R  ,  if 
F  is  orientation  preserving,  and  if  the  closure  of  W  is  invariant 
under  F,  then  W  has  a  rotation  number.  In  particular,  if  p  is  an 
isolated,  attracting  fixed  point  in  R^,  if  its  basin  W  is  not  all  of 
R  ,  and  if  F  is  orientation  preserving,  then  3W  has  a  rotation  number. 
(See  Sec.  2. ) 

G.D.  Birkhoff  recognized  that  the  set  of  accessible  points  is 
dense  in  the  boundary  of  an  invariant  region  and  that  their  dynamics 
can  be  characterized  by  their  rotation  number.  He  used  this  idea  in 
[B]  to  construct  a  map  of  the  annulus  into  itself  with  an  unusual 
invariant  set  J.  On  one  hand,  J  resembles  a  closed  Jordan  curve  in 
that  each  of  its  points  is  on  the  boundary  of  both  an  interior  region 
Sj^^^  (containing  one  boundary  circle  of  the  annulus)  and  an  exterior 
region  S^^j.  ^containing  the  other  boundary  circle).  On  the  other 
hand,  J  is  "remarkable"  in  the  sense  that  it  contains  a  dense  set  of 
points  accessible  from  with  one  rotation  number  and  a  dense  set 
accessible  from  with  a  different  rotation  number.  To  compare 
this  situation  with  our  hypotheses,  notice  that  such  a  map  has  an 


inverse  for  which  J  is  unstable  (in  S,  .  and  in  S  . )  and  J  is  the 

int  ext 

boundary  between  the  points  which  go  outward  and  those  which  go  inward 
(under  the  inverse). 

Cartwright  and  Littlewood  further  developed  these  ideas  in 
(C-Ll),  where  they  prove  the  existence  of  and  determine  the  stability 
of  periodic  orbits  for  a  certain  class  of  second  order  differential 
equations  in  the  plane.  More  recently,  J.  Mather  has  given  purely 
topological  proofs  of  some  of  the  topological  results  of  Caratheodory 
in  [Ml]  and  has  used  the  theory  to  study  invariant  sets  for 
area-preserving  homeomorphisms  of  the  annulus  (M2], (M3].  We  rely  on 
the  proofs  in  the  above  references  of  Cartwright-Littlewood  and  Mather 
for  much  of  the  material  on  prime  ends  given  in  Secs.  5,  6,  and  7.  A 
general  reference  for  Caratheodory’ s  theory  is  (C-Lo],  Chapter  9. 

The  following  argument  explains  the  significance  of  the 
Attracting  Lemma.  Assume  that  the  rotation  number  of  f  on  is 
rational  (say  the  reduced  fraction  p/q).  Then  will  have  at  least  1 
fixed  point  under  f*^,  (i.e. ,  a  periodic  point  of  period  q).  If  a 
trivial  circle  point  x  is  not  fixed  under  f'^,  then  its  orbit  converges 
to  a  fixed  point  r  under  iterates  of  f'^.  By  the  Attracting  Lemma,  r 
is  necessarily  a  trivial  circle  point.  Corresponding  to  r  is  an 
accessible  point  p  on  3W.  By  Property  2,  p  is  fixed  under  F^.  Thus 
we  have  the  following  result: 


Theorem  1.2.  Assume  that  aw  is  unstable  in  W  and  that  for  each  k 
the  fixed  points  of  F  are  isolated.  Assume  further  that  the  rotation 
number  p(aW,F)  is  p/q  (resp. ,  0).  Then  there  is  an  accessible  fixed 
point  of  F^  (resp. ,  F)  on  aW. 

In  Sections  6  and  7  we  describe  the  dynamics  on  the  set  of 

accessible  points  under  the  hypotheses  that  p  is  rational,  F  is  a 

diffeomorphism,  and  periodic  points  in  the  boundary  are  hyperbolic. 

(A  periodic  point  p  is  hyperbolic  if  the  Jacobian  matrix  DF(p)  has 

no  eigenvalues  with  absolute  value  1.  )  By  the  Inverse  Function 

Theorem,  a  hyperbolic  point  is  isolated  from  other  periodic  points  of 

the  same  period  (or  smaller  period).  In  the  following  theorem,  which 

is  a  special  case  of  Theorem  6. 1  in  Sec.  6,  we  assume  that  W  is  a 

basin  cf  attraction:  i.e. ,  there  exists  a  compact  set  K  in  W  such  that 

the  "u-limit  set"  of  the  orbit  of  each  point  x  in  W  is  non-empty  and 

is  contained  in  K.  (Given  a  point  x,  the  point  z  is  in  the  u-limit 

set  of  the  orbit  of  x,  if  there  exists  a  sequence  (t  ),  with  t  — >  », 
^  n  n 

such  that  f  "^(x)  — »  z.  )  If  the  orbit  of  each  point  in  W  is  bounded, 
then  there  exists  a  compact  set  K'  S  K  which  is  Liapunov  stable  (see 
Sec.  2  for  definition)  (DS). 
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Theorem  6.T.  Assume  that  the  periodic  points  of  F  in  3W  are 
hyperbolic  and  that  W  is  a  basin  of  attraction.  If  the  rotation 
number  p  is  rational,  then  every  accessible  point  either  is  a  periodic 
point  or  is  in  the  stable  manifold  of  an  accessible  periodic  point.  • 


Theorems  1.2  and  6.1'  do  not  mention  the  minimum  period  of  an 
accessible  periodic  orbit.  Degeneracies  can  occur  due  to  the  fact 
that  the  map  h^  is  not  necessarily  one-to-one  on  trivial  circle 
points,  so  that  the  period  of  the  accessible  points  can  strictly 
divide  the  period  of  the  orbit  on  S^.  In  Sec.  7  we  prove  that  such 
degeneracies  are  ruled  out  for  homeomorphis'^s  of  the  plane,  although 
they  can  still  occur  for  homeomorphisms  of  the  sphere.  We  use  the 
following  two  results.  The  first,  a  converse  of  Theorem  1.2  for 
planar  maps,  implies  that  the  period  of  an  accessible  periodic  point 
cannot  be  strictly  smaller  than  the  period  of  a  trivial  periodic 
circle  point.  The  second  implies  that  it  cannot  be  strictly  larger. 


Proposition  7.3.  Let  F  be  a  homeomorphlsm  of  the  plane  If 
there  exists  an  accessible  fixed  point  on  dU,  then  pOW,F)  is  0  . 


Proposition  7.4.  P  =  o.  then  every  accessible  periodic  point 
in  3W  is  a  fixed  point. 
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2 

Corollary  7.5.  Let  F  be  a  homeomorphism  of  the  plane  IR  .  If 
p  vt  0  Is  the  reduced  fraction  p/q,  then  every  accessible  periodic 
point  in  3W  has  minimum  period  q. 


The  next  corollary  (a  special  case  of  Cor.  7.6)  follows,  although 
not  directly,  from  Prop.  7.3,  Prop.  7.4,  and  Thm.  6.1'.  In 
particular,  it  remains  to  be  shown  that  if  the  orbit  of  an  accessible 
point  converges  to  a  fixed  point  in  aW,  then  the  fixed  point  is 
accessible.  We  point  out  that  this  corollary  does  not  mention  the 
rotation  number  p. 


Corollary  7.6\  Assume  the  following  conditions  hold: 

(1)  F  is  a  diffeomorphism  of  the  plane 

(2)  the  periodic  points  of  F  in  aW  are  hyperbolic: 

(3)  W  is  a  basin  of  attraction:  and 

(4)  either  (i)  there  exists  an  accessible  period  point  of 

minimum  period  q,  or 

(ii)  there  exists  an  accessible  point  which 
converges  (under  f^)  to  a  periodic  point  of 
minimum  period  q. 

Then  every  accessible  point  in  aW  either  is  a  periodic  point  of 
minimum  period  q  or  is  in  the  stable  manifold  of  such  a  periodic 
point. 
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In  Sec.  2  we  define  a  general  class  of  connected,  compact 
attractors  and  show  that  attractors  in  this  class  have  connected, 
simply-connected  basins.  In  Sec.  3  we  study  the  orientation-reversing 
case,  and  in  Sec.  4  we  apply  Theorem  1.2  to  a  class  of  chaotic 
attractors,  viewed  as  boundaries  for  the  inverse  of  the  map  F. 

Figures  1  through  4  were  made  using  Dynamics  [Y]. 
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2.  Attractors  with  Simply-Connected  Basins 


If  A  is  a  hyperbolic  fixed  point,  then  A  has  a  connected, 

simply-connected  neighborhood  which  contracts  to  it  under  iteration  by 

F.  In  this  case,  the  entire  basin  of  A  (see  Sec.  1  for  definition)  is 

connected  and  simply  connected.  Here  we  look  at  a  more  general  class 

of  attractors  and  show  that  their  basins  are  connected  and  simply 

connected  and  thus  satisfy  the  hypotheses  of  Theorems  1.1  and  1.2. 

(The  hypothesis  that  the  boundary  3W  is  unstable  in  U  is  trivially 

satisfied  if  either  the  attractor  A  does  not  intersect  3W  or  if  A  has 

a  dense  orbit  and  is  not  a  subset  of  3W.  ) 

For  a  closed  set  S,  let  S  be  the  c-neigh>'orhood  of  S;  i.e. ,  S 

c  c 

is  the  set  of  points  y  such  that  min  II  x  -  y  I!  <  c  ,  where  II  II 

xcS 

denotes  the  Euclidean  norm  in- We  say  a  set  A  is  a  regular 
attractor  if  A  satisfies  the  following  three  properties: 

(2.1)  A  is  compact  and  connected; 

(2.2)  A  is  Liapunov  stable;  i.e.,  for  each  neighborhood  Y  of  A 

there  exists  c>0  such  that  A  c  Y,  and  if  x  e  A  then  f''(x)  6  Y, 

e  e 

for  all  nil; 

(2.3)  The  basin  of  A  contains  an  open  neighborhood  of  A. 

In  the  following  proposition,  "area-contracting"  means 
specifically  that  there  exists  a  number  where  ?  <  1.  such  that 
Idet  DF(x)|  <  ^  ,  for  all  x  in 


Proposition  2.4.  Let  F  be  an  area-contracting  map  of  the  plane. 

If  A  is  a  regular  attractor,  then  the  basin  U  of  A  is  open,  connected, 
and  simply  connected. 

Proof.  Let  Y  c  U  be  an  open  neighborhood  of  A.  Let  c  >  0  be 

given  such  that  c  Y  for  all  n  a  0.  Select  5,  0  <  5  <  c, 

such  that  F^(A,)  c  A  c  Y  c  U,  for  all  n  a  J.  Such  c  and  5  exist, 
o  c 

since  A  is  Liapunov  stable. 

Let  X  e  U  be  given.  Choose  k  >  0  such  that  F^(x)  €  A^.  Since 
A  is  open,  there  is  an  open  neighborhood  V  of  x  which  maps  into  A 

C  X  c 

under  F^.  Thus  each  point  x  in  U  has  an  open  neighborhood  V  in  U, 

X 

and  U  is  open. 

Let  x^  and  x^  in  U  be  given.  Choose  integers  P>0  and  Q>0  such 
P  0 

that  F  (Xj)  €  A^  and  F  (^2)  e  A^.  Define  m  =  max  {P,Ql.  Then 

f"’(x,  )  and  F^Ix.,)  are  in  A  .  Since  A  is  connected,  A  is  connected  for 
1  <1  c  c 

each  e>0.  Hence,  A^  is  an  open,  connected  set.  Since  open,  connected 
sets  are  path  connected,  there  is  a  path  F  in  Y  connecting  f"*(Xj)  and 
f'"{x2).  Thus  F  "'(F)  lies  in  U  and  connects  x^  to  X2.  Therefore,  U 
is  connected. 

It  remains  to  show  that  U  is  simply  connected.  Suppose  that  U  is 
not  simply  connected,  and  let  C  be  a  simple  closed  curve  in  U  which 
bounds  a  region  D  containing  a  set  S  (consisting  of  one  or  more 
points)  that  is  not  in  U.  This  implies  that  the  distance  between 
F^(S)  and  A  is  at  least  c,  for  all  n  a  0.  Select  a,  0  <  a  <  5,  such 
that  F^(A^)  c  A^,  for  all  n  a  0.  Since  C  is  compact,  there  exists 


13 


an  integer  J(a)  >  0  such  that  c  . 

^*^(0  c  A^.  for  all  J  a  j(a).  We  conclude  that 
F^(S)  and  F^{C)  is  at  least  c-5  for  all  n  s  J(a). 


Therefore, 

the  distance  between 
On  the  other  hand, 


since  F  is  area  contracting,  the  distance  between  F^(S)  and  F^'CC) 
converges-  to  zero  as  n  ->  os.  This  contradicts  the  fact  that  c-5  >  0. 
Therefore,  U  is  simply  connected.  H 


3.  Continuation  and  Orientation-Reversing  Maps 


2 

Let  be  a  homeomorphism  of  R  depending  on  a  scalar 
parameter  We  assume  that  has  a  fixed  point  regular  attractor 
A^,  which  depends  continuously  on  A,  for  each  A.  We  define  the 
maximal  basin  W^^  to  be  the  largest  open  set  having  a  dense  set  of 
points  that  are  attracted  to  under  F^.  Let  be  the  boundary  of 
W^;  and  let  be  the  rotation  number  of  F^  on  C^,  the  accessible 
points  in  B^.  For  a  parametrized  homeomorphism  on  a  circle,  the 
rotation  number  varies  continuously  with  the  parameter  (see,  for 
example,  (D]).  Unlike  the  circle  case,  however,  is  not  necessarily 
continuous  in  A.  In  fact,  the  boundp'^y  B^^  can  jump  discontinuously, 
even  when  there  is  no  change  in  the  attractor.  It  was  shown  in  [HJ] 

(see  also  (GOY]  and  (ATYl)  that  when  the  stable  and  unstable  manifolds 

of  an  accessible  saddle  on  the  boundary  become  tangent  at  A  =  A,  and 
then  cross  for  A  >  A,,  the  stable  manifold  jumps  a  positive  distance 
c  (not  dependent  on  A)  into  W-,  for  each  A  >  A,.  Figure  2  shows  in 
black  the  basin  of  attraction  of  infinity  for  three  different  values 
of  the  parameter  A  in  the  Henon  map 

Fa  jj(x,y)  =  (A  -  x^  -by,  x)  (3.1) 

where  b  is  fixed  at  0.3.  There  is  a  period  two  attractor  in  the  white 

region  to  which  the  orbits  of  almost  all  white  points  tend.  Numerical 
experiments  indicate  that  for  A=1.39  (in  Fig.  2a),  a  period-four 
saddle  orbit  and  its  stable  manifold  are  the  only  boundary  points 
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accessible  from  the  white  region.  There  is  a  tangency  of  the  stable 

and  unstable  manifolds  of  consecutive  points  in  this  orbit  st  A  =  A, 

=  1.395.  Specifically,  if  we  number  the  four  points  in  the  orbit 

X, ,...,x,  consecutivelv  (in  the  counter-clockwise  direction  around 
1  4 

the  basin  boundary),  and  if  we  set  x  =  x  ,  for  n>4,  then  <x  } 

is  a  periodic  trajectory.  At  A=A,  the  unstable  manifold  of  x.  is 
tangent  to  the  stable  manifold  of  For  each  A  >  A,,  black 

points  appear  in  what  was  the  interior  of  the  white  region.  In 
addition,  it  has  been  numerically  observed  that  for  each  A  >  A,  (near 
A,),  the  set  of  accessible  boundary  points  is  composed  of  a 
period-three  saddle  and  its  stable  manifold.  Fig.  2bc  show  in  black 
the  basin  of  at  tract, ''n  of  infinity  at  A  =  1.4  and 
A  =  1. 42,  respectively,  with  the  accessible  period-three  saddle.  A 
numerical  investigation  of  rotation  numbers  for  the 
orientation-preserving,  area-contracting  Henon  map  appears  in  (AS). 

When  f  is  an  orientation-reversing  homeomorphism,  the  possible 

dynamics  on  accessible  orbits  are  limited.  For  a  connected,  simply 

connected  basin  of  attraction  W,  an  orientation-reversing 

homeomorphism  on  W  restricts  to  an  orientation  reversing-homeomorphism 

on  3W.  Again,  we  study  the  dynamics  on  3W  through  its  association 

with  the  circle.  An  orientation-reversing  homeomorphism  f  of  must 

have  fixed  points.  It  may  or  may  not  have  periodic  points  of  period 

two.  Notice,  however,  that  f  can  have  no  periodic  points  of  minimum 

2 

period  greater  than  2.  The  map  f  is  orientation  preserving  and  has 
rotation  number  0  since  it  has  fixed  points.  But  an 
orientation-preserving  homeomorphism  of  the  circle  with  rotation 
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number  0  has  no  periodic  orbits  of  minimum  period  greater  than  1. 

2 

Suppose  f  has  a  periodic  orbit  of  minimum  period  k,  k^.  Then  f  has 
a  periodic  orbit  of  minimum  period  k/2,  if  k  is  even,  or  of  minimum 
period  k,  if  k  is  odd.  Thus  f  has  only  periodic  points  of  period  one 
or  two. 

We  have  the  following  restatements  of  Theorems  1.1  and  1.2  for 
orientation-reversing  maps: 


Theorem  3.2  (Attracting  Lemma)-  Let  f  be  an 

orientation-reversing  homeomorphism  of  the  plane.  Assume  that  5W  is 

2 

unstable  in  W.  Assume  further  that  the  fixed  points  of  F  i  3W  are 
isolated.  Then  each  circle  point  that  is  fixed  under  and  is 
attracting  on  at  least  one  side  is  a  trivial  circle  point. 


Theorem  3.3.  under  the  hypothesis  of  Theorem  3.2,  there  is  an 

2 

accessible  fixed  point  of  F  on  5W. 


Let  F.  be  a  one-parameter  family  of  orientation-reversing 
A 

homeomorphisms.  From  Theorem  3.3,  we  observe  that  if  a  metamorphosis 

occurs  for  F.^,  then  B.^  must  jump  to  different  fixed  points  of  F^. 

A  A 
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Example.  The  Henon  map  (3.1)  is  orientation  reversing  for  b<0. 

It  is  easily  verified  that  ,  can  have  at  mst  2  fixed  points  and  at 
most  one  periodic  orbit  of  minimum  period  two.  In  this  situation  the 
possible  metamorphoses  are  severely  limited  by  Theorem  3.3.  As  long 
as  the  period-two  orbit  and  one  of  the  fixed  points  is  in  the 
attractor  (and  the  hypotheses  of  Thm.  3.2  are  satisfied),  no 
metamorphoses  will  occur.  If,  however,  the  basin  becomes 
disconnected,  as  shown  in  Fig.  3,  then  the  theorem  no  longer  applies 
and  the  boundary  can  be  fractal.  Fig.  3  shows  in  white  the  basin  of  a 
two-piece  attractor  (which  is  also  plotted  in  the  white  region).  A 
metamorphosis  has  occurred,  and  there  is  no  longer  an  accessible  fixed 
point  on  the  boundary.  Now  the  accessible  iddle  has  period  six. 

The  existence  of  periodic  orbits  in  the  maximal  basin  of  the 
attractor  but  not  in  the  attractor  itself  is  also  restricted  by  Thm. 
3.2.  Suppose  (3.1)  has  a  regular  attractor  A  (i.e. ,  A  satisfies 
Properties  (2. 1 )-(2. 3) ) .  If  A  contains  a  fixed  point  and  an  orbit  of 
period  two  or  if  (3.1)  is  in  a  parameter  range  where  there  is  no 
period-two  orbit  and  A  contains  a  fixed  point,  then  the  basin  U  of  A 
is  necessarily  bounded  by  the  stable  manifold  of  the  (other)  saddle 
fixed  point  p.  (For  every  choice  of  parameter  values,  the  orbits  of 
some  points  in  the  plane  go  to  infinity;  thus  the  basin  U  has  a 
boundary. )  In  particular,  under  these  hypotheses,  there  are  no 
periodic  orbits  in  the  region  containing  A  and  bounded  by  W  (p)  except 
those  in  A. 
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4.  Rotation  Numbers  for  Chaotic  Attractors. 


Here  we  look  at  a  class  4  of  non-periodic  attractors  in  the 
plane:  an  attractor  0  is  in  if  0  is  compact,  connected, 
invariant  under  F,  and  contains  more  than  one  point.  In  order  to 
apply  Theorem  1.2,  we  show  how  to  assign  a  rotation  number  to  an 
attractor  in  the  class  4,  assuming  that  F  is  an  area-contracting 
nomeomorphism  of  the  plane.  This  approach  is  reminiscent  of  Birkhoff 
[B]  and  also  of  Cartwright  and  Littlewood  [C-L2]  and  Levinson  [L]  who 
studied  attractors  in  forced  Van  der  Pol  type  equations. 

In  looking  at  the  Poincare  map  of  such  equations,  Cartwright  and 
LittlewooH  showed  that  there  are  invariant  annuli  which  have  unequal 
rotation  numbers  on  the  boundary  circles  and  which  possess  strange 
attracting  sets.  Each  such  attractor  is  the  boundary  of  the  inside 
contracting  and  outside  contracting  parts  of  the  annulus.  The 
existence  of  different  rotation  numbers  inherited  from  the  boundary 
circles  was  evidence  to  them  of  a  continuum  attractor  which  was  not 
homeomorphic  to  s\  Levinson  gave  a  careful  analysis  of  the 
attracting  invariant  set  of  a  piecewise-linear  version  of  this  map  in 
[Ln).  His  work  set  the  stage  for  the  discovery  of  the  horseshoe  map 
by  Smale.  See  also  Levi’s  analysis  of  forced  van  der  Pol  type 
equations  in  (Li). 

Let  Z  =  IR  u  {oo}  be  the  one-point  compactif ication  of  (R  .  Then 
F  extends  to  a  homeomorphism  of  Z  by  setting  F({co})  =  {oo}. 
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Lemma  4.1.  Let  F  be  an  area-contracting  homeomorphism  of  the 
2 

plane  (R  .  If  0  is  in  d,  then  Z  -  0  is  connected  and  simply-connected 
in  Z. 

Proof.  Since  0  is  connected,  each  component  of  Z  -  0  is  simply 

connected  in  Z.  (This  simple  fact  follows  most  clearly  from  Alexander 

Duality  with  Cech  cohomology.  See,  for  example,  (Do).)  Since  0  is 

compact,  only  one  component  D  of  IR  -  0  has  infinite  area  (in  R  ) 

00 

and,  given  any  bound  tj,  there  are  only  finitely  many  other  components 

with  area  larger  than  tj.  Let  D  be  a  component  of  R  -  0  with 

H 

2  -1 

maximum  finite  area  in  R  .  Since  F  is  area-expanding  and  components 

2  2-1 
of  R  -  0  map  onto  other  components  of  R  -  0,  F  maps  D  ont' 

M 

D  .  But  F"^  also  maps  D  onto  D  ,  contradicting  the  fact  that  F*^  is 
00  00  00 

a  homeomorphism.  Thus  Z  -  0  is  connected  and  simply  connected  in 

Z-  ■ 

Now  we  can  apply  Theorem  1.2  to  0,  which  is  the  boundary  of  the 
open,  connected,  simply-connected  region  Z  -  0.  By  looking  at  F  ^ 
instead  of  F,  it  can  be  shown  that  0  is  unstable  in  Z  -  0,  as 
follows.  Let  0^  be  an  c-neighborhood  of  0,  and  let  D  be  an  open  set 
in  0^  n  (Z-0)  .  Since  F  ^  is  area-expanding,  the  area  enclosed  by 
the  boundary  of  D  becomes  unbounded  under  iteration  by  F  \  It  can 
easily  be  shown  that  almost  all  points  in  D  Q  0^  eventually  will  be 
mapped  out  of  0^  under  iteration  of  F  S  hence,  0  is  unstable  in 
Z-0  under  F  Theorem  1.2  provides  the  following  result: 
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Proposition  4.2.  Let  F  be  an  area-contracting  homeomorphism  of 
the  plane,  and  let  0  be  in  the  class  A  of  attractors.  Assume  that, 
for  each  k,  the  fixed  points  of  are  isolated.  If  the  rotation 
number  p(0,F)  is  the  reduced  fraction  p/q,  then  there  is  an 
accessible  fixed  point  of  F*^  on  0. 

Figure  4  shows  an  attractor  for  the  Ikeda  map  with  an  accessible 
period  6  orbit.  For  a  typical  area-contracting  diffeomorphism 
depending  on  a  parameter  X,  we  conjecture  that  the  rotation  number 
p(A)  will  vary  continuously,  except  possibly  at  a  discrete  set  of 
values  of  X,  and  that  p(X)  will  'e  irrational  for  a  non-empty  set  of  X 
of  measure  0. 
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5.  Proof  of  the  Attracting  Lemma. 


Let  F  be  an  orientation-preserving  homeomorphisra  of 

Z  =  R  u  {«>,  the  1-point  compactification  of  the  plane.  A  simple  arc 

Q  in  W  with  end  points  and  q^,  q^^  *  on  3W  and  no  other  points 

on  3W  is  called  a  crosscut  of  W.  Each  crosscut  divides  W  into  2 

subdomains,  since  W  is  simply  connected.  Let  {Q^}  be  a  sequence  of 

pairwise  disjoint  crosscuts  such  that  separates  from 

Then  there  is  a  corresponding  sequence  {V^}  of  subdomains  of  W  such 

that  contains  except  for  its  endpoints.  See  Figure  5.  The 

sequence  V  o  V.  o  V  o  •••  is  called  a  chain.  If  V  =  IV  >  and 

*23  n 

V’  =  {V^}  are  t^o  chains,  we  say  V  divides  V’  if  for  each  i,  there  is 
a  j  such  that  Vj  S  We  say  V  and  V’  are  equivalent  if  each  divides 
the  other.  Under  this  relation,  an  equivalence  class  of  chains  is 
called  an  end.  A  chain  V  is  called  prime  if  any  chain  which  divides 
it  is  equivalent  to  it.  A  prime  end  is  the  equivalence  class  of  a 
prime  chain.  For  the  unit  disk  D  in  a  chain  {V^>  is  prime  if  and 
only  if  n  ^  single  point  (necessarily  on  the  boundary  sM.  In 

general,  if  there  exists  a  sequence  {Q^}  of  cross-cuts  defining  an  end 
V  such  that  {Q^}  converges  to  a  point  in  3W,  then  V  is  prime  (see,  for 
example,  (Ml)). 

Let  be  a  representative  chain  in  a  prime  end  V.  Since 

each  is  connected  and  W  is  compact  in  Z,  p|  V  is  a  connected, 

neIN  ^ 

compact,  non-empty  subset  of  Z.  Thus  it  is  either  a  single  point  or  a 

continuum.  We  call  I{V)  =  pj  V  the  impression  of  the  end  V.  The 

nelN 


22 


impression  of  V  is  independent  of  the  defining  chain  in  V.  (However, 
two  prime  ends  can  have  the  same  impression.  In  Fig.  1,  it  appears 
that  there  are  two  prime  ends  corresponding  to  non-trivial  circle 
points  and  that  both  have  impressions  that  equal  aW.  )  In  [C], 
Caratheodory  presents  an  example  of  a  domain  for  which  the  impression 
of  each  prime  end  is  a  continuum;  i.e. ,  none  is  a  single  point.  A 
point  p  in  I(V)  is  called  a  principal  point  of  V  if  there  exists  a 
sequence  of  crosscuts  (defining  a  chain  in  V)  such  that  {Q^} 
converges  to  p,  i.e.,  p  is  the  only  limit  point  of  this  sequence.  The 
set  of  all  such  points  is  cailed  the  principal  set  of  V.  Finally,  we 
say  a  point  r  in  aW  is  accessible  from  W  if  there  is  an  embedding  tj  of 
(0,1)  into  W  such  that  iim  7)(t)  =  p.  In  Fig.  6,  we  illustrate 
these  definitions.  The  following  lemmas  appear,  for  example,  in  (Ml) 
(as  Theorem  17.1  and  Corollary  15,  resp. ): 

Lemma  5.1.  The  principal  set  of  V  has  only  one  point  e  if  and 
only  if  e  is  accessible  from  W. 

Lemma  5.2.  The  principal  set  of  V  is  compact,  connected,  and 
non-empty. 

Now  we  describe  a  topology  on  the  set  of  prime  ends.  Let  V.  be  an 

open  set  in  W.  We  say  an  end  V  is  contained  in  li  (i.e. ,  V  e  K)  if 

there  exists  a  chain  {V  }  in  V  all  of  whose  elements  are  subsets  of  U. 

n 

Let  W*  =  U  V  S,  where  S  is  the  set  of  prime  ends  of  W.  A  set  U*  in 

W*  is  open  if  and  only  if  K*  n  W  is  open  (in  W)  and 
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XL*  n  S  =  {W:  V  contains  a  chain  all  of  whose  elements  lie  in  W}.  With 
this  topology,  a  sequence  {E^>  of  prime  ends  "converges"  to  a  prime 
end  E,  represented  by  ^V^>,  if  for  every  m,  there  exists  N(m)  6  IN 
such  that  E  S  V  for  every  n  >  N(m).  We  call  W*  together  with  this 
topology  the  prime  end  compac t i f i cat ion  of  W.  Central  to  the  theory 
of  boundary  sets  is  the  following  theorem  of  Caratheodory  (see,  for 
example,  [C-Lo]): 

Theorem  5.3  (Caratheodory).  Let  W  be  a  connected,  simply 
connected  open  set.  Assume  that  3W  has  more  than  one  point.  Then  W* 
is  homeomorphic  to  a  closed  disk,  where  points  in  W  correspond  to 
points  in  the  interior  of  the  disk,  ar-'^  the  prime  ends  correspond  to 
points  in  s',  the  boundary  of  the  disk.  Furthermore,  if  F  is  a 
continuous  map  on  Z  with  W  invariant  under  F,  then  there  is  map  F*  on 
W*  so  that  F*  =  F  on  W. 

With  this  theorem,  we  are  able  to  learn  about  the  dynamics  of  F 
on  the  boundary  of  W  by  studying  the  corresponding  dynamics  Ow  s\ 
the  bovindary  of  D.  Prime  ends  "map"  to  prime  ends  under  F;  hence  F 
induces  a  map  F*  on  W*.  Let  x  be  a  homeomorphism  from  W*  to  D,  the 
closure  of  D.  Then  the  circle  is  invariant  under  the  induced 
homeomorphism  f  =  toF*ot  '  of  D.  The  study  of  homeomorphisms  of  the 
circle  is  classical.  Here  we  mention  briefly  some  facts  about  these 
maps  which  are  needed  in  the  arguments  that  follow.  A  reference  for 
this  material  is  (D). 
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Poincare  showed  that  associated  with  each  orientation  preserving 
homeomorphism  y  of  the  circle  is  a  "rotation"  number,  an  asymptotic 
measure  of  the  rotation  of  points  on  the  circle  under  iteration  by  y. 
In  order  to  define  this  number,  it  is  convenient  first  to  consider  a 
"lift"  of  y.  A  map  G  of  IR  is  called  a  lift  of  y  if  ttoG  =  yon,  where 
It  is  the  covering  map  from  (R  to  S^;  i.e. ,  nix)  -  expCZitix).  Let 

p  (X)  =  lim  G''(y)/n, 

G  n-w 

for  X  in  and  y  in  (R  such  that  nly)  =  x.  (The  value  of  p  (x)  is 

c 

independent  of  the  choice  of  y. )  We  define  the  rotation  number  r  of  y 

to  be  the  unique  number  in  (0,1)  such  that  p  (x)  -  r  is  an  integer. 

c 

This  value  is  weli-def inedj 

Fact  C1.  The  value  r  =  r(y)  is  independent  of  both  x  and  the 
particular  lift  G  of  y. 


The  dynamics  of  y  are,  to  a  large  part,  described  by  the  rotation 
number  r(y): 

Fact  C2.  a  map  y  of  the  circle  has  points  of  minimum  period  q  if 
and  only  if  r(y)  is  an  irreducible  fraction  of  the  form  p/q,  for  some 
positive  integer  p.  The  map  y  has  fixed  points  if  and  only  if 
r(y)  =  0. 
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Thus,  if  y  has  periodic  points,  they  must  all  have  the  same 
period. 

Fact  C3.  if  y  a  periodic  point  of  period  n,  then  every  point 
on  the  circle  is  either  a  fixed  point  of  y^  or  is  asymptotic  to  a 
fixed  point  under  iterates  of  y*^. 


In  the  following  set  of  definitions,  we  describe  various  notions 
of  stability  for  periodic  points  and  periodic  prime  ends.  We  often 
mention  only  fixed  points,  but  the  definitions  and  lemmas  which  follow 
carry  over  to  periodic  points  by  considering  the  appropriate  iterate 
of  f:  a  periodic  point  of  period  n  is  a  fixed  point  of  f^. 

A  fixed  point  p  on  is  called: 

(1)  attracting  on  one  side  if  all  nearby  points  on  one  side  of 
p  converge  to  it  under  iteration  by  f; 

(2)  repelling  on  one  side  if  all  nearby  points  on  one  side  of 
p  converge  to  it  under  iteration  by  f"\ 

The  analogous  definitions  hold  on  the  space  of  prime  ends  if  the 
word  "point"  is  replaced  by  the  term  "prime  end",  and  if  "f"  is 
replaced  by  “F*". )  By  Fact  C3,  an  isolated  fixed  point  p  on  is 
either  attracting  or  repelling  on  each  side.  If  p  is  attracting 
(resp. ,  repelling)  on  one  side,  then  by  Caratheodory’ s  Theorem,  the 
associated  prime  end  !P  is  attracting  (resp. ,  repelling)  on  one  side. 

A  prime  end  ?  fixed  under  F*  is  called  weakly  stable  from  W  if  ? 
contains  a  chain  {V^}  such  that  F(Vj^)  a  V^,  for  every  i.  The 
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following  lemma  follows  easily  from  the  definition  of  SW  being  unstable 
in  W  (see  Sec.  1): 

Lemma  5.4.  3W  is  unstable  in  W,  then  no  fixed  prime  end  is 
weakly  stable  from  W. 


The  following  three  lemmas  are  important  in  relating  fixed  points 
of  F  on  dU  to  fixed  points  of  f  on  S^.  Although  there  is  a  fixed  prime 
end  corresponding  to  each  fixed  point  on  the  circle,  it  is  not  the 
case  that  a  prime  end  which  is  fixed  under  F*  necessarily  contains  a 
point  which  is  a  fixed  poj.nt  of  F.  Lemma  5.5  appears  in  (C-Lll. 


Lemma  5.5  (Cartwright-Littlewood).  Let  P  be  a  fixed  prime  end  of 
F*.  and  let  (Q^}  be  a  chain  of  cross  cuts  converging  to  a  point  q 
(necessarily  a  principal  point)  of  P.  If,  for  every  1,  F(Qj^)  has  at 
least  one  point  in  common  with  Qj^,  then  q  is  a  fixed  point  of  F. 


Lemma  5.6.  if"  3W  is  unstable  in  W  and  if  a  fixed  prime  end  T  is 
attracting  on  one  side,  then  all  principal  points  of  P  are  fixed  under 
F. 


Proof.  Suppose  P  is  attracting  on  one  side.  Let  z  be  a 
principal  point  of  P.  By  Lemma  5.2,  there  exists  a  sequence  {Q^^}  of 
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cross-cuts  converging  to  z.  Let  {V^>  be  the  chain  defined  by  these 
crosscuts.  By  throwing  out  elements  of  the  chain  where  necessary,  we 
can  assume  that  either  F(Qj. )  n  ^  0,  for  all  i,  or  that  F(Qj^)  is 
disjoint  from  Qj^,  for  all  i.  In  the  former  case,  z  is  fixed,  by  Lemma 
5.5.  Suppose  that  F(Qj^)  is  disjoint  from  for  all  i.  Then 
(toF)(Qj^)  is  disjoint  from  t(Qj^),  for  all  i,  and  r(.9)  =  p  is 
attracting  on  one  side.  Let  on  be  the  end  point  of  t(Qj^)  which 
is  on  that  side  of  p.  Then  for  i  sufficiently  large,  f^IcTj^)— >p,  as 
n— w.  Since  ^(Qj^)  and  (toF)(Qj^)  are  disjoint,  we  then  have  that 
(toF)(Q^)  c  t(vJ‘).  But  then  F(V^)  c  V^.  for  all  i,  contradicting 
Lemma  5.4.  Thus  z  is  fixed  under  F.  ■ 


Proof  of  Theorem  1.1  f^ttracting  Lemma).  Suppose  that  x  is  a 
periodic  circle  point  of  period  n  and  that  x  is  attracting  on  one 
side.  Then  the  corresponding  prime  end  T  is  fixed  under  (F  )  and 
attracting  on  one  side.  By  Lemma  5.6  all  principal  points  of  P  are 
fixed  under  F^.  By  Lemma  5.2  the  set  of  principal  points  is 
connected.  Since  fixed  points  of  F*^  are  isolated,  there  can  be  only 
one  principal  point,  say  p.  By  Lemma  5. 1  the  point  p  is  accessible. 
For  a  given  curve  f  in  W  limiting  on  p,  the  corresponding  curve 
h  ^(D  (by  definition)  limits  on  a  trivial  point  r  in  s\ 
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6.  Hyperbolicity 


In  this  section  we  describe  the  dynamics  on  the  set  of  accessible 
points  under  the  hypotheses  that  F  is  a  diffeomorphism  of  either  the 
plane  or  the  sphere  and  that  periodic  points  in  the  boundary  are 
hyperbolic.  In  addition,  we  either  assume  that  W  is  a  basin  of 

I 

attraction  (see  Sec.  1  for  definition)  or  we  add  a  condition  on  the 
map  F  at  »  .  We  say  that  oo  is  repelling  in  W  if,  for  each  r^^  >  0, 
there  exists  >  0  such  that  if  lx|  <  r^,  then  IF^'Cx)!  <  r^, 
for  all  X  in  U  and  n  i  0. 

Theorem  6.1,  Assume  that  the  periodic  points  of  F  in  3W  are 
hyperbolic,  and  that  either  (i)  W  is  a  basin  of  attraction,  or  (ii) 
aw  is  unstable  in  W  and  os  is  repelling  in  W  .  If  the  rotation  number 
p  is  rational,  then  every  .accessible  point  either  is  a  periodic  point 
or  is  in  the  stable  manifold  of  an  accessible  periodic  point. 


The  following  lemmas  are  used  in  the  proof  of  Theorem  6.1.  For 

each,  the  hypotheses  of  Theorem  6.1  are  assumed.  Let  S  be  a  (finite) 

s  u 

periodic  saddle  of  F  in  aW,  and  let  W  (resp. ,  W  )  represent  either 
branch  of  the  stable  (resp.,  unstable)  manifold  of  S,  excluding  S. 


Lemma  6.2-  3W  intersects  W^,  then  W^  and  W  are  disjoint. 
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Proof.  If  W  is  a  basin  of  attraction,  then  clearly  W  eind  W  are 

disjoint.  Suppose  therefore  that  5W  is  unstable  in  W,  that  »  is 

—  s 

repelling  in  W,  and  that  both  oW  and  W  intersect  W  .  Let  be  a 

crosscut  in  W  p)  W^,  and  let  =  FCQ^).  Then  W  -  U  Q^)  has 

three  components.  One  component  meets  both  auid  Let  be  the 

component  that  meets  only  Q^,  emd  let  be  the  component  that  meets 

only  0^.  Then  =  FCD^). 

Since  -o  is  repelling  in  W  and  W  is  invariant  under  F,  there 
exists  a  compact  set  K  such  that  F(K  pj  W)  is  contained  in  K  Q  W 
and  an  open  neighborhood  of  S  is  in  K.  Iterating  forward,  there 
exists  a  sequence  {D^}  of  open  ets  in  W  intersecting  W  such  that 
{D^>  approaches  (locally),  as  n-xa.  Given  e  >  0,  choose  J 
sufficiently  large  u.  that  intersects  K  and  there  is  no  e-disk  in 
p^  K  for  all  n  >  j.  (This  is  possible  since  K  includes  an  open 
neighborhood  of  S  and  there  are  only  a  finite  number  of  c-disks  inside 
K. )  Then  for  n  >  J,  every  point  in  p)  K  is  within  c  of  the 
boundary,  contradicting  the  hypothesis  that  3W  is  unstable  in  W,  • 


Lemma  6.3.  if  P  e  is  a  trivial  fixed  point,  then  it 
corresponds  to  an  accessible  fixed  point  S  in  the  boundary  3W.  If  S  is 
a  repeller,  then  so  is  p. 
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Proof.  Corresponding  to  p  is  an  accessible  point  S  in  5W-  The 
point  S  is  necessarily  a  fixed  point  since  accessible  points  map  to 
accessible  points  and  S  is  the  only  accessible  point  corresponding  to 
the  prime  end  p. 

Suppose  that  S  is  a  repeiier.  Since  the  boundary  dV  is  connected 

and  more  than  one  point,  each  circle  centered  at  S  of  sufficiently 

small  radius  must  intersect  3W.  Let  y  be  an  "accessing"  path  in  W 

which  limits  on  S  (corresponding  to  a  path  in  the  disk  which  limits  on 

p).  and  let  (Q^}  be  a  sequence  of  crosscuts  converging  to  3  such  that 

(1)  Q  is  an  arc  of  a  circle  of  radius  l/(n+N)  for  some  fixed  integer 
n 

Nil.  and  (2)  y  intersects  Q  an  odd  number  of  times,  for  each  n.  As 

n 

described  in  Sec.  5,  since  the  sequence  {Q^}  converges  to  one  point 
(i.e. ,  the  point  S  ),  it  defines  a  prime  end.  Since  this  prime  end 
has  accessible  point  S  with  accessing  path  y,  it  is  represented  by  p 
on  S^.  By  the  construction,  p  is  a  repeiier  on  S^n 


We  say  that  two  iccessing  paths  y^  and  y^  are  equivalent  if 
can  be  homotoped  to  y^  via  a  continuous  family  of  paths  that  remains 
in  W,  all  having  the  same  endpoint  S,  (i.e.,  if  there  exists  a 
continuous  family  g^:  I  — ^  W  such  that  gpd)  =  Tq.  g^d)  =  and 

g^(0)  =  S,  for  all  tel).  Notice  that  if  S  has  two  non-equivalent 
accessing  paths,  then  it  corresponds  to  (at  least)  two  different 
circle  points  under  h^. 

In  the  next  two  lemmas,  we  assume  the  following  additional 
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hypotheses:  (1)  S  is  an  accessible  fixed  point  saddle;  and  (2)  S  has 

an  associated  trivial  circle  p  which  is  attracting  on  at  least  one 

side,  (i.e. .  there  exists  a  point  2  e  S^,  z  *  p,  such  that 

lim  f^(z)  =  p). 
n — xx) 

For  e  small,  let  be  the  union  of  the  segments  of  the  stable 
and  unstable  manifolds  that  connect  S  to  the  boundary  of  B^(S),  the 
e-ball  around  S.  We  can  assume  that  e  is  small  enough  that  the 
segments  of  the  stable  and  unstable  manifolds  in  intersect  only 
at  S. 


Lemma  6.4.  Let  r  be  an  accessing  curve  to  S.  Th~n  7  is 
equivalent  to  an  accessing  curve  that  does  not  intersect 


Proof.  Suppose  that  7  is  not  equivalent  to  an  accessing  curve 

that  does  not  intersect  Since  W  is  open,  it  must  be  the  case  that 

7  intersects  at  least  two  components  of  B  (S)  -  M  and  that  both  7 

c  e 

s  u 

and  the  boundary  5W  intersect  W  p  or  both  intersect  W  p|  The 

s 

case  in  which  both  intersect  W  is  ruled  out  by  Lemma  6.2.  Suppose 
that  both  intersect  W^.  Let  {Q^}  be  a  sequence  of  crosscuts 
converging  to  S  such  that  is  a  closed  interval  on  and 
intersects  7  an  odd  number  of  times,  for  each  n.  (Since  the  endpoints 
of  are  the  only  points  of  on  the  boundary  dW,  we  can  assume  in 
fact  that  intersects  7  only  once. )  The  prime  end  determined  by 
{Q^}  is  represented  by  p  on  the  circle.  In- this  case,  p  must  be  a 
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repeller,  a  contradiction. 


In  the  following,  let  e  >  0  and  let  y  be  an  accessing  path  to  S 

such  that  there  is  a  unique  component  of  that  intersects 

y.  Call  this  component  Q  .  (The  existence  of  Q  is  guaranteed  by 

Lemma  6.4.  )  Since  S  is  hyperbolic,  we  can  further  assume  that 

is  a  neighborhood  in  which  F  is  smoothly  conjugate  to  a  linear  map, 

2 

that  S  is  the  origin,  and  that  is  an  (open)  quadrant  in  R  . 


Lemma  6.5.  The  component  Q^,  as  defined  above,  contains  no  points 
of  the  boundary  dU. 


Proof.  Suppose  that  contains  a  point  of  9W.  Let  e^,  aeR,  be 
a  family  of  ("hyperbolic-like")  invariant  curves  in  Q^.  Since  the 
boundary  is  connected,  there  is  a  connected  component  of  5W  p| 
containing  S  and  a  point  b  of  e  ,  for  e  sufficiently  close  to  S. 

cl  ct  ^ 

Assume  e^  is  sufficiently  close  to  S  that  y  extends  from  S  to  a  point 
g  on  e  .  Assume  g  is  below  b  on  e  (the  argument  is  similar  if  it 

^3.  3  3  3 

is  above).  Assume  further  that  F(g  )  is  above  b  .  (Otherwise  take  a 

a  a 

higher  iterate. )  Then  F(g  )  is  between  b  and  F(b  )  on  e  . 

a  a  a  a 

Since  y  and  f(y)  are  both  accessing  curves  to  S  (and  they 
correspond  to  curves  in  the  disk  limiting  on  the  same  circle  point), 
g  and  F(g  )  can  be  Joined  by  a  curve  contained  entirely  in  W  so  that 
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the  resulting  loop  ^  is  null-homotopic  in  W,  This  is  a  contradiction 
since  either  b  or  F(b  )  is  contained  in  S.  ■ 

a  a  ^  ■ 


Proof  of  Theorem  6.1.  We  assume  that  the  rotation  number  is  0. 

(If  the  rotation  number  is  p/q  with  p*0  ,  then  replace  F  by  F*^  in 
the  proof. )  Let  x  be  an  accessible  point  in  dW  which  is  not  a  fixed 
point.  Corresponding  to  x  is  a  trivial  circle  point  z.  By  Lemma  6.3, 
z  is  not  a  fixed  point.  Then  the  forward  orbit  of  z  converges  to  a 
fixed  point  p  on  S^.  By  the  Attracting  Lemma,  p  is  a  trivial  circle 
point.  Corresponding  to  p  is  an  accessible  point  S  in  5W.  By  Lemma 
6.3,  is  a  fixed  point.  Since  either  W  is  a  basin  of  attraction  or 

fiW  is  unstable  in  W,  S  cannot  be  an  attractor,  and  again  by  Lemma  6.3, 
S  is  not  a  repeller.  Thus  S  is  a  saddle,  and  the  hypotheses  of  Lemmas 
6.4  and  6.5  are  satisfied  by  S,  since  p  is  attracting  on  one  side. 

By  Lemmas  6.4  and  6.5,  there  is  at  least  one  component  of 
B^(S)  -  which  is  in  W  and  contains  no  boundary  points.  If  there 
are  boundary  points  in  another  component  of  B^(S)  -  M^,  then  they  are 
in  connected  components  of  3W  which  intersect  both  invariant  manifolds 
bounding  that  component.  If  exactly  one  component  is  free  of  boundary 

s 

points  and  is  in  W,  then  there  are  accessible  points  on  one  branch  W 
of  the  stable  manifold  and  one  branch  w'^  of  the  unstable  manifold.  By 
Lemma  6.2,  each  point  on  this  branch  of  is  an  accessible  boundary 
point.  Thus  points  on  one  branch  of  the  stable  manifold  of  S  are  in 
one-to-one  correspondence  with  points  of  on  one  side  of  p. 

Let  and  refer  to  the  segments  on  either  side  of  p 
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consisting  of  points  on  the  circle  between  p  and  the  closest  fixed 
points  on  either  side.  (If  p  is  the  only  fixed  point,  then  =  13^.  ) 

Let  be  the  segment  which  corresponds  to  W  .  Necessarily,  is  part 

of  the  stable  set  of  p.  Let  {Q^}  be  a  sequence  of  crosscuts 

converging  to  S  such  that  one  endpoint  of  is  on  and  one  is  on 

s  u 

W  ,  for  each  n.  Since  accessible  boundary  points  on  W  converge  under 

F  ^  to  S,  given  a  point  y  in  pj  dW  (necessarily  accessible)  and 

n>0,  all  but  a  finite  number  of  points  in  the  forward  orbit  of  y  under 

F  ^  will  be  in  V  ,  the  closure  of  the  domain  determined  by  Q  and  S. 

n  n 

In  this  case  p,  which  corresponds  to  the  prime  end  determined  by 

is  repelling  on  Since  the  forward  orbit  of  z  converges  to  p,  z 

must  be  on  3^,  and  thus  x  is  in  the  stable  •'mifold  of  S. 

The  argument  given  in  the  previous  paragraph  holds  in  all  cases 

in  which  a  sequence  (Q^)  of  crosscuts  in  W  converging  to  S  (i.e.,  a 

sequence  which  defines  the  prime  end  represented  by  p)  has  the 

u  s 

property  that  one  endpoint  of  is  in  W  and  one  is  in  W  ,  for  all 
n  i  0.  The  case  in  which  there  are  exactly  three  components  of 
B^(S)  -  in  W  which  are  free  of  boundary  points  also  reduces  to 
this  case.  If  the  crosscuts  do  not  have  this  property,  then  there  are 
necessarily  exactly  two  or  exactly  four  components  in  W.  In  these 
cases,  both  endpoints  of  a  crosscut  are  in  one  or  the  other  branch  of 
the  stable  manifold  of  S.  (Since  the  fixed  point  p  is  attracting  from 
at  least  one  side  on  s\  the  case  in  which  only  the  unstable  manifold 
of  S  intersects  the  boundary  is  ruled  out  by  an  argument  similar  to 
that  in  the  proof  of  Lemma  6.3. )  In  this  case,  p  is  necessarily 
attracting  on  the  circle,  and  points  on  both  and 
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one-to-one  correspondence  with  points  in  the  stable  manifold  of  S. 
Thus  X  is  in  the  stable  manifold  of  S.  ■ 


The  following  corollaries  follow  from  the  proof  of  Theorem  6.1. 
The  first  extends  Theorem  1.1  (the  Attracting  Lemma)  to  all  points  of 
S^,  not  Just  periodic  points.  The  second  shows  that  the  map  h^  ,  the 
accessible-point  extension  of  the  Riemann  map  h  (described  in  Sec.  1), 
is  continuous  on  stable  manifolds  of  periodic  points  of  (up  to  and 
including  the  periodic  point).  For  a  trivial  circle  point  r,  we  let  r 
denote  the  corresponding  accessible  point  in  3W.  We  assume  the 
hypotheses  of  Theorem  6. 1. 


Corollary  6.6.  Assume  that  p  is  rational.  If  a  point  r  in  is 
not  a  periodic  point,  then  r  is  a  trivial  circle  point. 

Corollary  6.7.  p  in  be  a  periodic  point  of  f,  and  let 

(r^)  be  a  sequence  of  point?  in  converging  to  a  point  r.  If  is 

in  the  stable  manifold  of  p,  for  each  n,  then  the  corresponding 
sequence  (r^)  of  accessible  points  in  3W  converges  to  r  in  3W. 
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7.  Minimum  Periods  of  Accessible  Periodic  Orbits 


Unfortunately,  although  a  rational  rotation  number  p/q  implies 

that  f  has  a  periodic  orbit  of  minimum  period  q  on  s\  we  cannot  claim 

that  F  has  a  periodic  point  of  minimum  period  q.  See,  for  example, 

the  boundary  depicted  in  Fig.  7,  where  p(5W, F)  is  1/3,  and  F  has  an 

accessible  fixed  point  on  the  boundary  but  no  period  three  orbit. 

Recall  that  h^  is  the  accessible-point  extension  of  the  Riemann 

map  h.  If  the  rotation  number  p  of  f  is  rational  (say  p/q),  but  not 

0,  then  trivial  circle  points  which  are  periodic  (necessarily  of 

minimum  period  q)  can  map  by  h  to  periodic  points  in  the  plane  of 

c 

smaller  minimum  period.  This  situation  is  illustrated  in  Fig.  7, 
where  all  points  in  one  orbit  on  the  circle  coalesce  to  a  fixed  point 
on  the  sphere.  Surprisingly,  Cartwright  and  Littlewood  (C-Ll)  showed 
that  this  type  of  example  is  the  only  possible  one  when  accessible 
points  coalesce; 


Theorem  7.1  (Cartwrlght-Llttlewood).  If  p  *  0,  then  3W  contains 
at  most  one  accessible  fixed  point. 


It  is  easily  seen  that  this  theorem  rules  out  coalescing  to  an 
orbit  of  minimum  period  strictiy  between  1  and  q.  Suppose  that  a 
trivial  periodic  orbit  of  minimum  period  q  on  the  circle  maps  (under 
h^)  to  a  periodic  orbit  of  minimum  period  k  on  3W,  where  and  ks^q. 
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Then  k  =  q/r  for  some  divisor  r  of  q  (r?^!),  and  has  k  accessible 
fixed  points  on  3W.  But  the  rotation  number  of  the  induced  map  f  on 
the  circle  is  non-zero,  contradicting  the  theorem. 


The  situation  illustrated  in  Fig.  7  can  be  largely  overcome  by 
using  Theorem  6. 1  and  assuming  that  the  accessible  periodic  points  are 
saddles. 


Proposition  7.2.  Assume  the  hypotheses  of  Theorem  6.  1.  If  the 
rotation  number  p  *  0  is  the  reduced  fraction  p/q,  where  q  *  2, 
then  every  accessible  periodic  saddle  in  3W  has  minimum  period  q. 


Proof,  Suppose  there  exists  an  accessible  orbit  of  period  k  on 
3W,  where  l<k<q.  Then  F  has  at  least  k  fixed  points,  but  the 
rotation  number  of  the  induced  circle  map  f  is  non-zero, 
contradicting  Theorem  7.  1.  Hence  we  assume  there  is  an  accessible 
fixed  point  saddle  z  on  3W.  Given  a  path  F  in  W  limiting  on  z,  let  y 
be  the  trivial  circle  point  which  is  the  limit  point  of  h^  ^(F). 
Either  y  is  a  periodic  point  of  period  q,  or  the  forward  orbit  of  y 
under  f^  converges  to  a  periodic  point  r.  By  Theorem  1.1,  r  is  a 
trivial  circle  point.  By  Corollary  6.4,  the  trivial  circle  point  r 
corresponds  to  the  accessible  point  z  (i.e. ,  h^(r)  =  z  ),  as  do  each 
of  the  q  points  r  =  r^,  r2,...,r^  in  the  orbit  of  r. 
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Let  0  be  the  center  of  the  disk  which  bounds  and  let 
3^1.  ••’.y  be  line  segments  Joining  0  to  r.,...r  ,  respectively. 

Then  hCy^) . P^iths  in  W,  all  of  which  limit  on  z.  Let 

r^^  and  r^  be  adjacent  points  on  the  circle.  Since  r^,,..,r^ 
represent  distinct  prime  ends  on  S^,  the  closed  loop  formed  by  hCy^^), 
h(yj),  and  z  necessarily  contains  boundary  points  in  its  interior. 
These  boundary  points  are  connected  to  z  within  the  loop. 

Therefore,  by  Lemma  6.5,  q  can  be  at  most  4. 

If  q  is  3  or  4,  then  at  least  one  branch  of  the  stable 

manifold  of  z  is  in  3W,  and  r  is  necessarily  attracting  on  at 
least  one  side  of  the  circle  under  f^  — as  is  each  of  the  q  points  in 
the  orbit  of  z.  Each  of  these  stable  sets  must  correspond  to  a 
branch  of  the  stable  manifold  of  z.  On  the  other  hand,  there  exists 
a  path  r  in  the  disk  connecting  a  point  in  the  stable  set  of  r^^  to 
a  point  in  the  stable  set  of  r^  which  crosses  one  of  the  segments 
or  j-j  exactly  once  and  intersects  none  of  the  other  segments. 
Hence,  in  W,  hCD  crosses  (or  hCy^))  exactly  once  and 

intersects  none  of  the  other  "accessing"  paths,  a  contradiction  for 


For  a  map  of  the  sphere,  two  types  of  degeneracies  are  possible 
when  p  =  1/2,  even  with  the  hypothesis  that  accessible  orbits  are 
hyperbolic  saddles.  These  possibilities  are  illustrated  in  Fig.  8. 

In  Fig.  8a,  p  =  1/2  and  there  is  an  accessible  fixed  point  saddle  p 
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on  3W.  In  Fig.  8b,  aW  is  a  line  segment.  The  basin  W  (the 
complement  of  B)  is  simply  connected  on  the  sphere.  In  this  case, 
p  =  1/2  and  there  is  an  accessible  fixed  point  saddle  p  and  an 
accessible  saddle  orbit  {rj^,r2}  of  period  two. 


The  situation  is  greatly  simplified  when  we  look  at 
homeomorphisms  of  the  piane.  We  use  the  following  converse  of 
Theorem  1.2  for  planar  maps: 


2 

Proposition  7.3.  '  F  be  a  homeomorphlsm  of  the  plane  R  .  If 

there  exists  an  acces-iOle  fixed  point  in  aW,  then  p  -  0. 


Proof.  Suppose  *  0.  Let  x  be  an  accessible  fixed  point, 

and  let  p  e  be  a  corresponding  trivial  circle  point.  Since 

p  *  0,  we  can  choose  N  >  1  such  that  the  intervals  (p,  f(p)l, 

(f(p),  f^(p)l,...,  (f^  ^(p),  f^{p)J  cover  S^  By  Property  2  of  the 

extension  h  of  the  Riemann  map,  h  (f^(p))  =  x,  for  i  i  1. 
c  c 

Let  r  and  S  be  paths  beginning  at  a  point  0  in  D  and 
ending  at  p  and  f(p),  respectively.  Let  F  be  the  closed  loop 
formed  by  h(y),  h(5),  h(0).  and  x.  Choose  a  preferred  direction, 
clockwise  or  counterclockwise,  so  that  the  accessible  boundary  points 
corresponding  to  trivial  circle  points  between  p  and  f(p)  are  in 
r.  Let  G  be  r  together  with  its  interior.  Since  the  accessible 
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points  are  dense  in  5W,  the  entire  boundary  is  contained  in  the 

N  . 

compact  set  K  =  U  f  (G)  .  The  complement  of  D  is  contained 
i=l 

entirely  in  W  or  entirely  in  (r\w.  The  former  case  is  ruled  out 
since  W  is  simply  connected.  But  then  hCy)  c  W  is  in  the  boundary 
of  K,  a  contradiction.  - 


Now  assume  that  p  is  the  reduced  fraction  p/q.  Assume 

further  that  there  is  an  accessible  periodic  orbit  of  minimum  period 

n  r  1 

r  in  3W  (in  the  plane).  The  iterate  F  induces  the  map  f  on  S  . 

r  r 

Since  F  has  a  fixed  point,  the  rotation  number  of  f  is  0,  by 

Prop.  7.3.  Thus  all  periodic  points  cf  f  in  s'  are  fixed  points  of 

f 

f  ,  which  implies  that  q  divides  r.  The  next  proposition  shows 
that  q  must  equal  r. 


Proposition  7.4.  P  =  o.  then  every  accessible  periodic 
pjoint  in  3W  is  a  fixed  point  of  F. 


Proof.  Assume  there  is  an  accessible  periodic  point  x  of 
period  q,  q  >  1.  Let  p  be  a  trivial  circle  point  corresponding  to 
X.  By  Property  2  of  the  map  h^,  p  is  not  a  fixed  point.  Let  0 
be  the  center  of  D,  let  be  the  line  segment  from  0  to  p, 

and  let  be  the  line  segment  from  0  to  f^(p),  for  each  i, 
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ISIS  q+1.  Then  h  (y  )  and  h  (y  )  both  contain  p,  and  they 

c  o  c  q 

form  a  closed  curve  r  which,  except  for  p,  is  contained  in  W. 

Since  p  =  0,  f(p)  is  between  p  and  f*^(p)  on  one  side  of 

the  circle  and  f*^^^(p)  is  between  them  on  the  other  side.  Tims  one 

of  n  (y.)  and  h  (y  _ )  is  inside  f  and  the  other  is  outside, 
c  i  c  q+1 

By  Property  2  of  the  map  h  , 

c 

h^(f(p))  =  F(l)  (p))  =  F(x)  =  F^''^(x)  =  F'^'^^(h^(pJ)  ••=  h^(f‘^^^(p)). 
c  c  c  c 

But  only  one  of  h  (f(p))  and  h  (f^^^(p))  is  in  f,  a 
0  c 

contradiction.  ■ 


2 

Corollary  7.5.  Let  l  be  a  homeomorphlsm  of  the  plane  OR  .  If 
p  *  0  is  the  reduced  fraction  p/q,  then  every  accessible  periodic 
point  in  3W  has  minimum  period  q. 


Proof.  Suppose  there  is  an  accessible  periodic  point  with  period 
r.  By  the  discussion  following  Prop.  7.3,  q  divides  r.  It  follows 
from  Prop.  7.4  that  since  the  rotation  number  of  f*^  (on  S^)  is  0, 
q  must  equal  r.  m 


The  final  corollary  puts  together  the  previous  results  with  the 
assumption  of  hyperbolocity  to  obtain  a  statement  that  does  not 
mention  the  rotation  number  p: 
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Corollary  7.6.  Assume  the  following  set  of  hypotheses: 

(1)  F  is  a  diffeomorphism  of  the  plane 

(2)  the  periodic  points  of  F  in  dW  are  hyperbolic; 

(3)  either  (i)  W  is  a  basin  of  attraction;  or 

(ii)  5W  is  unstable  in  W,  and  »  is  repelling  in  W; 
and  (4)  either  (i)  there  exists  an  accessible  periodic  point  of 
minimum  period  q,  or 

(ii)  there  exists  an  accessible  point  which 
converges  (under  f*^)  to  a  periodic  point  of  minimum 
period  q. 

Then  every  accessible  point  in  aW  either  is  a  periodic  point  of 
minimum  period  q  or  is  in  the  stable  manifold  of  such  a  periodic 
point. 


Proof.  We  need  to  prove  that  if  an  accessible  point  x  converges 
under  f*^  to  a  periodic  point  z,  then  z  is  accessible.  First  we 
show  that  p  is  rational.  Assume  otherwise.  (For  ease  of 
exposition,  we  assume  that  q  is  I  and  that  z  is  a  fixed  point. 
Otherwise,  replace  F  with  F*^.  )  By  hypothesis,  x  is  on  one  branch  W^ 
of  the  stable  manifold  of  z.  Let  y  be  a  point  in  W,  and  let 
and  g^  'be  paths  from  y  to  x  and  from  y  to  F(x), 
respectively. 

g 

By  Lemma  6.2,  W  and  W  are  disjoint.  (This  lemma  does  not  depend 
on  any  assumption  about  p. )  Therefore,  there  must  be  accessible 
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points  in  the  region  V  bounded  by  g^,  g^,  and  the  portion  of 

between  x  and  F(x).  In  fact,  since  p  is  irrational,  there  must 
be  points  in  the  orbit  of  the  accessible  point  x  in  the  region  V. 
But  then  must  enter  V.  The  only  way  can  enter  V  is  through  g^, 
gj,  or  W^,  all  of  wh?ch  are  impossible.  (In  particular,  g^  and 
gj^  are  in  W,  which  by  Lemma  6.2  does  not  intersect  W  .  )  Therefore, 
p  ir  rational,  and  by  Theorem  6.1,  x  is  in  the  stable  mcinifold  of 
an  accessible  periodic  point,  namely  z. 

Since  z  has  minimum  period  q  and  p  is  rational,  by  Cor.  7.5, 
eve-y  accessible  periodic  point  has  minimum  period  q;  the  result 
follows  from  Theorem  6. 1.  ■ 
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FIGURE  1.  Two  basins  of  attraction  of  the  time  In  map  of  the  forced  damped 
pendulum  equation  0"  +  .10'  +  sin©  =  2cost  are  shown  in  black  and  white. 
The  black  and  white  regions  are  connected  on  the  cylinder. 


FIGURE  2.  A  portion  of  the  basin  of  infinity  of  the  Henon  map  (3.1)  is 
shown  in  black  for  b  fixed  at  0.3  and  each  of  three  values  of  the  para¬ 
meter  X.  The  X  and  y  values  shown  are  in  the  rectangle  [-2,2]  x  [-2,11]. 
In  (a)  at  X=  1.39,  the  set  of  accessible  points  consists  of  a  period-four 
saddle  and  its  stable  manifold.  Crosses  show  a  period-three  saddle  to 
which  the  boundary  jumps  at  a  boundary  metamorphosis  at  ^  ~  1.395.  In 
(b)  and  (c)  at  \  =  1.40  and  X  =  1.42,  respectively,  the  set  of  acces¬ 
sible  points  consists  of  this  period-three  saddle  and  its  stable  manifold. 


FIGURE  3.  A  portion  of  the  basin  of  infinity  of  the  orientation- 
reversing  Henon  map  (3.1)  is  shown  in  black.  There  is  a  two- 
piece  attractor  whose  basin  is  not  connected,  and  the  basin 
boundary  is  fractal. 
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FIGURE  4.  A  chaotic  attractor  of  the  Ikeda  map 

f(x,y)  =  (.97  +  0.9(xcost  -  ysinr),  0.9(xsinT  +  ycost)), 

where  t  =  0.4  -  6. 0/(1. 0  +  x^+y^) ,  is  shown.  There  is  an 
accessible  period  6  orbit  on  the  attractor. 


FIGURE  6.  Each  figure  represents  an  open,  simply  connected  set 
(the  interior  of  the  rectangle  minus  the  line  segments).  In  each 
case,  segment  AB  is  the  impression  of  a  prime  end.  In  (a),  each 
point  of  AB  is  a  principal  point,  and  there  are  no  accessible  points 
in  AB.  In  (b),  segment  CD  is  the  principal  set  of  AB,  and  there  are 
no  accessible  points  in  AB.  In  (c),  P  is  the  only  principal  point 
and  the  only  accessible  point  of  AB, 
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FIGURE  7.  In  (a)  the  rotation  number  on  the  boundary  circle  is 
1/3.  The  circle  maps  to  the  boundary  in  (b) ,  however  the  boundary 
in  (b)  does  not  have  an  accessible  periodic  point  ot  period  3,  but 
rather  has  an  accessible  fixed  point.  This  example  is  realizable 
on  the  sphere,  not  in  the  plane. 
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FIGURE  S.  Two  types  of  degeneracies  on  the  sphere,  in  which  the  minimum 
periods  of  accessible  saddles  do  not  equal  the  periods  of  orbits  of  the 
associated  circle  map,  are  shown.  Sy  Prop.  7.2,  the  rotation  numbers  in 
each  case  is  1/2.  In  (a),  the  boundary  9W  has  a  Eiiced  point  saddle  p. 

In  (b),  W  is  the  complement  in  the  sphere  of  the  line  segment  3U  from  rj^ 
to  r^;  thus  3W  is  the  boundary  of  a  simply  connected  set  on  the  sphere. 
Again,  the  rotation  number  is  1/2  and  there  is  an  accessible  fi:ced  point 
saddle  p  and  an  accessible  saddle  orbit  period  tv?o. 
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Figure  1 


Two  basins  of  attraction  of  the  time  2u  map  of  the  forced  damped 
pendulum  equation  0"  +  . 10’  +  sin0  =  2cost  are  shown  in  black  and 
white.  The  black  and  white  regions  are  connected  on  the  cylinder. 


Figure  2 

A  portion  of  the  basin  of  infinity  of  the  Henon  map  (3.1)  is 
shown  in  black  for  b  fixed  at  0.3  and  each  of  three  values  of  the 
parameter  A.  The  x  and  y  values  shown  are  in  the  rectangle 
(-2,2)  X  [-2,11].  In  (a)  at  A  =  1.39,  the  set  of  accessible  points 
consists  of  a  period-four  saddle  and  its^ stable  manifold.  Crosses 
show  a  period-three  saddle  to  which  the  boundary  Jumps  at  a  boundary 
metamorphosis  at  A  «  1.395.  In  (b)  and  (c)  at  A  =  1.40  and 
A  =  1.42  ,  respectively,  the  set  of  accessible  points  consists  of  this 
period-three  saddle  and  its  stable  manifold. 


Figure  3 

A  portion  of  the  basin  of  infinity  of  the  orientation-reversing 
Henon  map  (3.1)  is  shown  in  black.  There  is  a  two-piece  attractor 
whose  basin  is  not  connected,  and  the  basin  boundary  is  fractal. 


Figure  4 

A  chaotic  attractor  of  the  Ikeda  map 

f(x,y)  =  (.97  +  0.9(xcost  -  ysinx),  0.9(xsinT  +  ycosx)), 

2  2 

where  t  =  0.4  -  6. 0/(1. 0  +  x  +  y  ),  is  shown.  There  is  an  accessible 
period  6  orbit  on  the  attractor. 


Figure  5 

Sequences  of  crosscuts  and  subdomains  defining  a  prime  end  are 
i 1 lustra ted- 


Figure  6 

Each  figure  represents  an  open,  simply  connectea  set  (the 
interior  of  the  rectangle  minus  the  line  segments).  In  each  case, 
segment  AB  is  the  impression  of  a  prime  end.  In  (a),  each  point  of  AB 
is  a  principal  point,  and  there  are  no  accessible  points  in  AB-  In 
(b),  segment  Q)  is  the  principal  set  of  AB,  and  there  are  no 
accessible  points  in  AB.  In  (c),  P  is  the  only  principal  point  and 
the  only  accessible  point  of  AB. 


Figure  7 

In  (a)  the  rotation  number  on  the  boundary  circle  is  1/3. The 
circle  maps  to  the  boundary  in  (b),  however  the  boundary  in  (b)  does 
not  have  an  accessible  periodic  point  of  period  3,  but  rather  has  an 
accessible  fixed  point.  This  example  is  realizable  on  the  sphere,  not 
in  the  plane. 


Figure  8 

Two  types  of  degeneracies  on  the  sphere,  in  which  the  minimum 
periods  of  accessible  saddles  do  not  equal  the  periods  of  orbits  of 
the  associated  circle  map,  are  shown.  By  Prop.  .7.2,  the  rotation 
number  in  each  case  is  1/2.  In  (a),  the  boundary  3W  has  a  fixed  point 
saddle  p.  In  (b),  W  is  the  complement  in  the  sphere  of  the  line 
segment  3W  from  r^^  to  thus  9W  is  the  boundary  of  a  simply 

connected  sot  W  on  the  sphere.  Again,  the  rotation  noiTiber  is  1/2  and 
there  is  an  accessible  fixed  point  saddle  p  and  an  accessible  saddle 
orbit  {r^,r2}  of  period  two. 


WHEN  CANTOR  SETS  INTERSECT  THICKLY 
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Abstract 

The  thickness  of  a  Cantor  set  on  the  real  line  is  a  measurement  of  its  “size”.  Thick¬ 
ness  conditions  have  been  used  to  guarantee  that  the  intersection  of  two  Cantor  sets 
is  nonempty.  We  present  sharp  conditions  on  the  thickness  of  two  Cantor  sets  which 
imply  that  their  intersection  contains  a  Cantor  set  of  positive  thickness. 


1  Intro  duct  icn 

Newhouse  defined  [5]  a  nonnegative  quantity  called  the  “thickness”  of  a  Cantor  set  in  order 
to  formulate  conditions  which  will  guarantee  that  two  Cantor  sets  intersect.  (All  Cantor  sets 
considered  in  this  paper  lie  in  R^.)  These  conditions  have  been  used  [5,  6,  7,  8,  9]  in  the 
study  of  two-dimensional  dynamical  systems  to  deduce  the  existence  of  tangencies  between 
stable  and  unstable  manifolds  whose  one-dimensional  cross  sections  are  Cantor  sets. 

Thickness  may  be  thought  of  as  a  meeisure  of  how  large  a  Cantor  set  is  relative  to 
the  intervals  in  its  complement.  Henceforth,  these  intervals  will  be  referred  to  as  gaps] 
the  two  unbounded  intervals  in  the  complement  are  each  included  in  our  use  of  the  term 
gap.  Newhouse’s  result  [5,  7,  8]  is  that  two  Cantor  sets  must  intersect  if  the  product  of 
their  thicknesses  is  at  least  one,  and  neither  set  lies  in  a  gap  of  the  other.  When  this 
latter  condition  is  satisfied,  the  sets  are  said  to  be  interleaved.  In  [10],  Williams  observed 
the  surprising  fact  that  two  interleaved  Cantor  sets  can  have  thicknesses  well  above  one 
and  still  only  intersect  in  a  single  point.  One  might  hope  that  under  sufficiently  strong 
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Figure  1:  Constructing  a  Czintor  set 


thickness  conditions,  the  intersection  would  be  a  Cantor  set.  However,  the  intersection 
of  two  arbitrarily  thick  interleaved  Cantor  sets  can  contain  isolated  points,  so  Williams 
posed  the  question  of  what  conditions  on  the  thicknesses  of  two  interleaved  Cantor  sets 
will  guarantee  that  their  intersection  contains  another  Cantor  set,  Williams  obtained  such 
a  condition,  though  it  is  not  sharp.  In  this  paper  we  obtain  the  sharp  condition.  More 
precisely,  we  find  a  curve  in  (Ti,T2)-space  such  that  if  the  ordered  pair  of  thicknesses 

of  two  interleaved  Cantor  sets  lies  above  the  curve,  their  intersection  contains  a  Cantor 
set,  but  if  the  pair  of  thicknesses  lies  below  the  curve  here  exist  examples  for  which  the 
intersection  is  a  single  point.  Kraft  [2]  has  independently  arrived  at  this  condition.  We 
further  show  that  if  the  thickness  pair  lies  above  the  curve,  the  intersection  must  contain  a 
Cantor  set  of  positive  thickness.  This  is  the  only  result  that  addresses  in  terms  of  thickness 
how  large  the  intersection  of  two  Cantor  sets  must  be.  There  are  well  known  probabilistic 
results  concerning  the  Hausdorff  dimensions  of  intersections  of  Cantor  sets  (c.f.  [1,  3,  4]). 

One  may  think  of  a  Cantor  set  as  being  constructed  by  starting  with  a  closed  interval 
and  successively  removing  open  gaps  in  order  of  decreasing  length.  Williams’  formulation  of 
the  thickness  of  a  Cantor  set  may  then  be  thought  of  as  follows.  Each  gap  is  removed 
from  a  closed  interval  leaving  behind  closed  intervals  £„,  the  left  piece  of  and 

Rn  on  the  right  (see  Figure  1.)  Let  /?„  be  the  ratio  of  the  length  of  the  smaller  of  £„  and  i2„ 
to  the  length  of  Gn-  The  thickness  of  the  set  is  the  infimum  of  over  all  n. 

We  consider  as  an  example  the  “middle-third”  Cantor  set,  constructed  as  follows.  Start 
with  the  closed  interval  [0,1],  and  remove  the  open  interval  (1/3, 2/3),  the  miadle  third  of 
the  original  interval.  Then  from  each  of  the  two  remaining  intervals,  remove  their  middle 
thirds;  repeat  this  process  infinitely  often.  Each  gap  Gn  is  the  same  length  as  the  adjacent 
intervals  £„  and  Rn,  so  pn  =  I  for  all  n.  Thus  the  thickness  of  the  middle-third  Cantor  set 
is  one. 

There  is  a  connection  between  the  thickness  of  a  Cantor  set  and  its  fractal  dimension, 
which  depends  in  part  on  how  the  ratios  pn  are  distributed  as  n  -+  00.  However,  two  large 
gaps  close  together  make  the  thickness  of  a  set  very  small,  while  its  dimension  can  still  be 
large.  It  was  shown  in  [7]  that  the  Hausdorff  dimension  of  a  Cantor  set  with  thickness  r  is 
bounded  below  by  log  2/  log(2  -f  1/r).  This  lower  bound  is  sharp  for  the  middle-third  Cantor 
set  (whose  dimension  is  log  2/ log  3.) 

We  offer  here  a  new  formulation  of  the  definition  of  thickness  which  we  state  for  all 
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Figure  2:  Non-intersecting  interleaved  sets 


compact  sets,  not  just  Cantor  sets.  (The  results  in  this  and  previous  papers  are  found  to 
be  Vcdid  for  all  compact  sets.)  We  define  non-degenerate  intervals  to  have  infinite  thickness, 
while  singletons  are  defined  to  have  thickness  zero.  In  fact,  any  set  containing  an  isolated 
point  will  be  seen  to  have  thickness  zero.  To  define  the  thickness  of  a  compact  set  5  which 
is  not  an  interval,  we  consider  a  type  of  subset  of  S  obtained  by  intersecting  5  with  a  closed 
interval.  We  call  such  an  intersection  P  a  chunk  of  5  if  P  is  a  proper  subset  of  S  and  has  a 
positive  distance  from  S  —  P,  the  complement  of  P  in  S.  (Notice  that  for  P  to  be  a  chunk 
both  P  and  S  —  P  must  be  closed  and  nonempty.)  We  then  define  the  thickness  of  5  to  be 
the  infimum  over  all  chunks  P  of  the  ratio  between  the  diameter  of  P  and  the  distance  from 
P  to  5  —  P.  In  the  case  of  the  middle-third  Cantor  set,  the  given  ratio  can  be  shown  to  be 
smallest  when  the  chunk  P  is  obtained  by  intersecting  S  with  an  interval  or  P„,  in  which 
case  the  ratio  is  one.  In  Section  2  we  will  show  that  our  new  definition  is  eq”' valent  to  the 
old  one  for  all  Cantor  sets. 

The  reason  thickness  is  an  appropriate  quantity  for  determining  when  one  can  guarantee 
that  two  compact  sets  intersect  is  illustrated  by  considering  an  example  where  each  of  the 
two  sets  is  a  union  of  two  disjoint  intervals.  For  i  =  i,2  let  5,  consist  of  closed  intervals 
of  lengths  a,  and  6,  with  a,  <  6,,  separated  by  a  distance  c,-.  Then  each  Si  has  only  two 
chunks,  and  is  found  to  have  thickness  a,/c,.  If  the  product  of  the  thicknesses  aiaijcxc^  is 
at  least  one,  then  either  Cj  >  C2  or  >  Cj  (or  both);  assume  Oj  >  C2.  Then  since  6i  >  Ui, 
neither  interval  of  S\  can  lie  in  the  gap  of  52;  hence  if  the  two  sets  are  interleaved,  they  must 
intersect.  If  on  the  other  hand  aia2/ciC2  <  1,  then  with  an  affine  map  we  can  scale  the  sets 
so  that  Cl  <  C2  and  02  <  ci,  and  position  them  so  that  the  component  of  5i  with  length  ci 
lies  inside  the  gap  of  52,  and  vice  versa.  The  two  sets  are  then  interleaved,  but  they  do  not 
intersect  (see  Figure  2).  This  example  could  of  course  be  made  to  involve  Cantor  sets  by 
constructing  very  thick  Cantor  sets  in  each  chunk  of  each  5,-. 

An  important  point  which  is  apparent  in  the  above  example  is  that  the  union  of  two 
sets  can  have  a  smaller  thickness  than  either  of  the  original  sets.  In  other  words,  adding 
points  to  a  set  can  decrease  its  thickness.  By  the  same  token,  one  may  be  able  to  increase 
the  thickness  of  a  set  by  removing  appropriate  subsets.  This  observation  is  useful  in  the 
following  way.  No  matter  how  thick  two  interleaved  compact  sets  are,  their  intersection  may 
have  thickness  zero  because  it  may  contain  isolated  points,  or  arbitrarily  small  chunks  which 
are  relatively  isolated  from  the  rest  of  the  intersection.  Nonetheless  we  are  able  to  show  that 
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Figure  3:  The  intersection  of  two  interleaved  compact  sets  with 
thicknesses  T\  and  can  be  empty  for  (tj,  73)  in  region  A,  must  be 
nonempty  but  can  be  a  single  point  in  region  5,  and  must  contain 
a  set  of  positive  thickness  in  region  C. 


if  the  original  sets  are  thick  enough,  then  by  throwing  out  the  relatively  isolated  parts  of 
their  intersection  we  can  obtain  a  set  of  positive  thickness  in  the  intersection. 

To  define  the  set  C  of  thickness  pairs  for  which  a  Cantor  set  of  intersection  can 

be  guaranteed,  we  make  use  of  the  functions 


/(’•)  = 


+  3r  +  1 


Let  C  be  the  set  of  pairs  (Ti,r2)  for  which  one  of 

the  following  sets  of  conditions  holds: 

IV 

T\  >  /(T2), 

and 

>  gin) 

(1.1) 

or 

r2  >  Ti, 

(see  Figure  3.)  Our  main  result  is 

T2  >  /(ti), 

as  follows. 

and 

n  >  g{T2) 

(1.2) 
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Theorem  1  There  is  a  function  Y?(Ti,r2)  which  is  positive  in  region  C  such  that  for  all 
interleaved  compact  sets  Si,  ^2  C  R  with  t{Si)  >  ti  mid  rlSz)  >  T2,  theK  is  asetSC.  5iniS'2 
with  thickness  at  least  v?(ri,T2). 

Notice  that  a  compact  set  with  positive  thickness  can  have  no  isolated  points,  and  thus  must 
either  be  a  Cantor  set  or  contain  an  interval;  either  way  it  contains  a  Cantor  set. 

We  remark  that  (ri,T2)  is  in  C  if  both  thicknesses  are  greater  than  \/2  +  L  This  is  the 
critical  value  Williams  found  ^or  the  czise  of  interleaved  Cantor  sets  with  the  same  thickness. 
Also,  no  matter  how  small  one  thickness  is,  the  other  thickness  can  be  chosen  large  enough 
so  that  the  pair  lies  in  C.  Our  results  and  the  results  of  Newhouse  are  summarized  in  Figure 
3. 

In  Section  2  we  give  a  proof  of  Newhouse ’s  result,  which  will  illustrate  some  of  the  methods 
to  be  used  later.  Then  we  present  for  all  pairs  (Ti,r2)  not  in  C  an  example  of  interleaved 
compact  sets  with  thicknesses  ti  and  T2  whose  intersection  is  a  single  point  (except  when 
(ri,r2)  is  on  the  boundary  of  C,  in  which  case  our  example  gives  a  countable  intersection.) 
This  example  shows  that  Theorem  1  is  sharp  in  that  its  conclusion  cannot  hold  for  any  larger 
set  of  thickness  pairs  (ri,r2).  In  Section  3  we  prove  Theorem  1,  and  in  Section  4  we  discuss 
some  further  properties  of  5;  D  52-  The  positive  thickness  set  S  ^  S\C\  Si  constructed  in 
Section  3  need  not  be  dense  in  5i  H  ^2;  however  we  find  that  there  are  subsets  with  thickness 
at  least  v?(Ti,r2)  arbitrarily  near  any  accumulation  point  of  S\  H  Si.  In  addition,  we  find 
bounds  on  the  diameter  of  S  which  allow  us  to  obtain  thickness  conditions  that  imply  that 
the  intersection  of  three  Cantor  sets  is  nonempty. 


2  Preliminaries 


Let  us  define  precisely  the  concepts  and  notation  we  will  use. 

Definition  1  We  say  two  sets  S\,S2  C  R  are  interleaved  if  each  set  intersects  the  interior 
of  the  convex  hull  of  the  other  set  (that  is,  neither  set  is  contained  in  the  closure  of  a  gap  of 
the  other  set.) 

We  define  the  distance  between  two  nonempty  sets  Si,  S2  to  be 


diSuSi)  =  inf{|x  -y| 


X  e  Si,  ye  S'2}, 


and  write  S2  —  Si  for  the  intersection  of  S2  with  the  complement  of  Si.  We  say  that  a  set  Si 
is  a  chunk  of  a  set  5^,  and  write  5i  oc  52,  if  Si  is  the  intersection  of  a  closed  interval  with 
S2,  is  a  proper  subset  of  52,  and  d(5i,  52  -  5i)  >  0.  Notice  that  a  closed  set  5  has  a  chunk  if 
and  only  if  it  is  not  connected.  We  denote  the  diameter  of  a  '^et  5  (the  length  of  its  convex 
hull)  by  |51. 
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Figure  4:  Chunks  and  gaps  of  a  Cantor  set  (k  <  n) 


Definition  2  Given  a  compact  set  5  C  !R,  loe  define  the  thickness  of  S  to  be 


\p\ 


d{P,S-P) 


(2.1) 


provided  S  has  a  chunk.  Otherwise,  we  let  r(S)  =  0  if  S  is  empty  or  consists  of  a  single 
point,  and  r(5)  =  oo  if  S  is  an  interval  with  positive  length. 

The  following  simple  proposition  demonstrates  that  Definition  2  agrees  with  Williams’ 
definition  of  thickness  for  Cantor  sets  (10). 


Proposition  2  Let  S  be  a  Cantor  set,  and  define  the  ratios  as  in  the  introduction.  Then 
the  quantity  t{S)  given  by  (2.1)  is  equal  to  the  infimum  of  pn  over  all  n. 


Proof  The  intervals  and  i?„  defined  in  the  introduction  are  the  convex  hulls  of  chunks 
An  =  Ln  0  S  and  Bn  =  Rn  C\  S  oi  S.  Since  the  gap  Gn  is  not  larger  than  any  previously 
removed  gap  Gk,  k  <n,  it  follows  that 


d{An,S-An)=d{Bn,S~Bn)=^\Gn\ 


(see  Figure  4.)  Thus  for  all  n, 


Pn  =  min 


'\Ln\  |i?nl 


=  mm 


Uni 


|5n| 


AAn,S-Anyd{Bn,S-Bn)^ 


>t{S). 


Next,  if  P  is  a  chunk  of  5,  it  must  be  bordered  on  each  side  by  a  gap  of  5;  let  be  the 
smaller  of  these  two  gaps.  Then  iG„|  =  d{P,S  -  P)  and  |P|  >  min(|i„|,  lPn|)-  Therefore 


r(5)  =  inf 


\P\ 


P^sd{P,S-P)  -  n 


>  infpn, 


which  completes  the  proof  I 

We  now  prove  Newhouse’s  result  in  a  way  that  will  motivate  our  later  examples  and 
methods. 


Proposition  3  If  Si  and  S2  are  interleaved  compact  sets  with  r{Si)-T{S2)  >  then  3x0  32 
IS  not  empty. 
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S-i: 


Figure  5:  The  points  x„  and  chunks  P„ 


Proof  Let  Si  and  S2  be  as  above,  and  let 

lo  =  tnax  (  inf  x,  inf  x  1 , 

the  greater  of  the  leftmost  points  of  Si  and  S2.  Assume  without  loss  of  generality  that 
xo  €  Si-  We  will  show  that  Si  fl  is  nonempty  by  looking  for  the  leftmost  point  of  this 
set.  Let  Xi  be  the  leftmost  point  of  5i  which  is  at  least  as  great  as  xq.  Since  Si  and  S2 
are  interleaved,  xj  must  exist  (otherwise  Si  would  lie  entirely  to  the  left  of  ^2;  see  Figure 
5.)  Xext,  let  X2  be  the  leftmost  point  of  S2  greater  than  or  equal  to  xi.  Once  again  the 
interleav.ng  assumption  implies  that  X2  exists,  for  otherwise  S2  would  lie  inside  a  gap  of  5i. 
We  similarly  define  X3,X4,  . . . ;  if  each  of  these  points  can  be  shown  to  exist,  we  claim  to  be 
done.  Then  {x„}  will  be  a  nondecreasing  sequence  which  is  bounded  above  (since  Si  and 
S2  are  bouiided),  so  it  approaches  a  limit.  This  limit  must  belong  to  both  Si  and  ^2  since 
these  sets  are  closed  and  the  odd  numbered  terms  of  {x„)  belong  to  5i,  the  even  ones  to  5i. 

If  at  any  step  x,,  exists  and  equals  x„_i,  then  Xn+i,Xn+2)  •  •  -  will  also  equal  x„„i,  and  we 
will  have  found  a  point  in  Si  fl  52.  Henceforth  we  assume  xq  <  Xj  <  •  •  •  as  long  as  they  are 
defined.  We  know  at  least  that  xq,  Xj,  and  X2  exist,  so  there  is  a  chunk  Po  of  S2  which  lies 
in  (xo,Xi),  whose  diameter  is  thus  less  than  Xi  —  xo,  and  whose  distance  from  the  rest  of  S2 
is  greater  than  X2  —  xj  (see  again  Figure  5.)  Then 


Xl  -  Xq 
X2  —  Xl 


\Po\ 

d{Po,S2-Po) 


>  r{S2). 


(2.2) 


Let  Pi  be  the  largest  chunk  of  5i  which  lies  in  [xi,X2).  If  X3  did  not  exist,  in  other  words  if 
all  points  in  5i  were  less  than  xi,  then  5i  —  Pi  would  lie  to  the  left  of  Pi,  and  the  distance 
beiween  these  sets  would  be  greater  than  xi  —  xq.  But  then  using  (2.2)  and  T(5i)-r(52)  >  1 
we  woulu  have 


l-Pil  3:2 -Xl 

d(Pi,5i-Pi)  xi-xo 

contradicting  the  definition  of  the  thickness  of  5i. 
obtain 


Thus  X3  exists,  and  similarly  to  (2.2)  we 


X2  —  Xl 


lAI 


>  r{Si). 


(2.3) 


X3-X2  d{Pi,Si-Pi) 

Likewise  (2.3)  can  be  used  to  show  the  existence  of  X4,  and  so  forth.  The  proof  is  completed 
by  induction.  I 
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One  could  similarly  find  the  rightmost  point  in  S\  D  52,  but  as  Williams  observed  it 
may  coincide  with  the  leftmost  point,  even  if  both  thicknesses  are  significantly  greater  than 
1.  We  next  present  an  example  which  will  give  a  single  point  of  intersection  for  thickness 
pairs  (ri,r2)  not  in  the  closure  of  region  C,  and  a  countable  intersection  for  (ri,r2)  on  the 
boundary  of  C.  In  our  example  both  sets  are  countable  unions  of  closed  intervals,  but  they 
could  be  replaced  by  Cantor  sets  with  the  same  thicknesses  by  constructing  a  very  thick 
Cantor  set  in  each  of  the  closed  intervals. 

Let  r  be  a  positive  constant,  and  define  the  intervals 

Aq  =  [r^  +  3t  +  1,  (2r  +  1)^], 

Bo  ~  [r^T^  +  3r  +  1], 

=  ("27^) 

^“  =  (-27^)"^“-  . 

where  multiplication  of  a  set  by  a  scalar  means  the  set  obtained  by  multiplying  each  element 
of  the  original  set  by  the  given  scalar.  Let 

Si  =  (0  A.)  U  {0},  S,  =  f  Cl  U  (0}. 

Notice  that  is  the  closure  of  the  interval  between  An  and  An+2  for  all  n,  and  An  is  the 
closure  of  the  interval  between  Bn-2  and  for  n  >  2.  Thus  Si  H  S2  is  countable,  containing 
only  the  point  0  and  endpoints  of  the  intervals  An  and  B„.  Furthermore,  the  intersection 
could  be  reduced  to  only  the  point  0  by  shrinking  the  intervals  which  make  up  one  of  the 
sets  by  a  factor  arbitrarily  close  to  one. 

Let  us  compute  the  thicknesses  of  the  sets  5j  and  52.  Observe  that 

|/1„|  =  =  (2;^)’' ’•(3’-  +  1). 

|B„|  —  d{AniA„+j)  =  ^2,.  ^  1)  ^3’’  + 

The  intervals  An  are  ordered  from  left  to  right  Ai,  /I3,  /I5, . . . ,  A4,  A2,  Ao,  so  any  chunk  P  of 
5i  which  does  not  contain  0  must  be  a  finite  union  of  consecutive  even  or  odd  numbeieu  .4n. 
Let  An  be  the  interval  in  P  with  the  largest  index;  then 

=  r 

d{P,Si--P)-  d{An,An+2)  ’ 
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with  equality  holding  when  P  =  A„.  On  the  other  hand,  if  a  chunk  P  of  Si  contains  zero, 
let  n  be  the  larger  index  of  the  leftmost  and  rightmost  Ak  in  P.  Then  P  must  contain  i4„_i, 
and  since  P  is  not  all  of  5i,  n  >  2,  so 

\P\  >  |AnU^n-i|  ^  (r/(2r  +  l)r^(3r  +  l)(2r  +  l)  ^  ^ 

d(P,  Si-P)-  d(A„,  (r/(2r  +  l))-2(3r  +  1) 

Therefore  the  thickness  of  Si  is  r. 

Similarly,  if  P  is  a  chunk  of  ^2,  then  for  an  appropriately  chosen  Pn,  either 

d(F,S2-P)  -  ' 

or 

\P\  >  |BnUPn-l| 

d(P,52-P)  -  d(P„,P„_2) 

(r/(2r  +  l)r-^((3r  +  l)/(2r  +  l))(r^  +  3r  +  1) 

(T/(2r  +  l))’'"2T(3r  +  1) 

_  +  3t  +  1 

7^ 

=  /(r). 

Thus 

t(52)  =  min(/(r),5(r)). 

As  we  pointed  out  before,  by  reducing  the  thickness  of  S2  by  an  arbitrarily  small  amount 
we  can  shrink  the  intersection  of  Si  and  S2  to  a  single  point.  Let  tj  denote  the  thickness 
of  the  set  Si,  and  let  T2  be  the  thickness  of  52.  Then  up  to  a  change  of  indices,  the  above 
construction  demonstrates  that  a  single  point  of  intersection  can  be  obtained  when  either 


n  <  mm{f{r2),g{T2)) 


(2.4) 


or 

r2  <  min{/{Ti),^(ri)).  (2.5) 

Also,  if  either  (2.4)  or  (2.5)  is  an  equality  instead,  the  intersection  can  be  countable.  (Kraft 
[2]  has  analyzed  this  borderline  case  and  determined  when  the  interseciion  can  be  finite.) 
Therefore  we  can  only  hope  to  guarantee  an  uncountable  intersection  if 

n  >  min(/(T2),p(r2))  (2.6) 

and 

T2>  mm{f{Ti),g{Ti)).  (2.7) 

One  may  check  that  g{T)  >  /(r)  >\/2  +  lforr<\/2  +  l  and  ^(r)  <  /(r)  <  \/2  +  1  for 
r  >  \/2  +  1.  Therefore  (2.6)  and  (2.7)  are  equivalent  to  (1.1)  in  the  case  ti  >  T2,  and  to 
(1.2)  when  T2  >  ri. 
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Case  1  <  i.  —  io 

I  ^2:  <---( 

Jq 


f  -Si:  <- . 

Case  2  <  h 

[  S2:  <---H 

Jq 


Figure  6:  Cases  in  the  construction  of  I.  and  J. 


3  Proof  of  Main  Result 

We  now  prove  Theorem  1  by  constructing  a  set  5  with  positive  thickness  in  5i  H  52. 

Proof  of  Theorem  1  Let  S\  and  S2  be  interleaved  compact  sets  with  r(5i)  >  ti  and 
TiSi)  >  T2  for  some  (ti,  72)  in  region  C  of  Figure  3.  Let  the  gaps  of  S\  be  /o  hth,  with 
Iq  and  I\  unbounded,  Iq  to  the  left  of  /i,  and  j/^l  >  \h\  >  •  •  •.  For  S2  we  define  Jo,Ji,J2, 
...similarly.  We  refer  to  the  intervals  /„  and  collectively  as  the  “original  gaps”.  Our 
goal  is  to  construct  the  complement  of  5  as  a  union  of  disjoint  open  intervals  Kq^  Tij/fa, 
. . .  with  Kq  and  K\  unbounded,  and  with  every  original  gap  contained  in  some  Km  (whence 
5  C  5i  (152.)  To  get  a  lower  bound  on  the  thickness  of  5,  observe  that  every  chunk  P  of  5  is 
bordered  on  each  side  by  a  gap  of  5,  with  at  least  one  of  the  bordering  gaps  being  bounded. 
Pick  a  chunk  P,  and  say  P  is  bordered  by  Km  and  Kn  with  m  >  n  and  m  >  2.  Then 

\P\  d{KmJ<n)  ^  d{KmJ<n) 


d(P,5-P)  min{lA',,l,|/Vn|)  -  1/C,.| 

The  theorem  will  therefore  be  proven  when  we  show  for  some  ^{r\fT2)  >  0  that  whenever 
m>  n  and  m  >  2, 

d(/Cm, /(fn)  \  /o 

-i^>V>(n.r2).  (3.1) 

We  begin  by  finding  a  pair  of  original  gaps  1.  and  J.  between  which  5  will  lie;  that  is, 
/.  and  J,  will  be  contained  in  Kq  and  K\.  The  properties  we  desire  of  /.  and  J.  are  that 
they  are  a  positive  distance  apart,  that  all  gaps  of  5i  with  an  endpoint  between  the  closures 
of  1,  and  J.  are  bounded  and  no  larger  than  /.,  and  likewise  (in  comparison  to  J.)  for  gaps 
of  S2  between  /,  and  J,.  We  will  show  later  that  once  I.  and  J.  have  been  determined, 
the  diameter  of  5  can  be  bounded  below  by  a  constant  depending  on  rj  and  73  times  the 
distance  between  I.  and  J,. 

Assume  without  loss  of  generality  that  Jq  C  Iq.  If  h  C  J\  (Case  1  of  Figure  6),  then 
/.  =  Iq  and  J.  =  J\  have  the  above  properties;  they  must  be  separated  by  a  positive  distance 
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1 


52: 

5:  <- 


h--H 

*Jn 


h-f  H 

hH  H 


Ko 


Figure  7:  The  construction  of  Ko 


h-> 

f . -H 


since  S\  and  S2  axe  interleaved.  If  Ji  C  h  (Case  2  of  Figure  6),  let  J.  be  the  largest  gap 
of  S2  with  an  endpoint  between  Iq  and  I\,  and  let  /.  be  whichever  of  Iq  and  Ii  is  farthest 
from  J,.  At  least  one  of  Iq  and  I\  must  be  a  positive  distance  from  J.  since  Si  and  S2  are 
interleaved. 

Next,  let  t  be  a  positive  constant  whose  precise  value  will  be  chosen  later;  for  now  we 
assume  that  t  <  (tiTj  -  1)/(tj  +  72  +  2)  <  min(Ti,  T2).  Assume  without  loss  of  generality  that 
I,  lies  to  the  left  of  J.,  We  begin  constructing  Ko  by  requiring  that  it  contain  We  then 
require  that  Kq  contain  the  rightmost  bounded  Jn  with  d(/.,  <  t\Jn\  (we  will  verify  that 

there  is  a  rightmost  gap  satisfying  this  condition  when  we  later  examine  our  construction 
in  more  detail.)  If  there  does  not  exist  such  a  Jn  that  is  not  already  contained  in  we 
stop  the  construction  and  let  '"0  ==  Otherwise,  we  further  require  that  Ko  contain  the 
rightmost  bounded  that  is  within  t  times  its  length  of  the  previously  added  Jn.  Again, 
if  this  requirement  does  not  extend  Kq  any  farther  rightward,  we  stop  the  construction.  If 
not,  we  then  add  to  Kq  the  rightmost  J/  which  is  within  t  times  its  length  of  Im  and  is  at 
most  as  large  as  Jn  (see  Figure  7.)  If  a  next  step  is  necessary,  we  consider  gaps  of  Si  which 
are  no  larger  than  and  so  forth.  We  may  have  to  continue  this  process  infinitely  often, 
but  if  so  we  must  converge  to  a  right  endpoint  for  A'o,  since  there  is  no  Wt.y  this  construction 
can  extend  past  the  rightmost  point  in  5i  U  52. 

We  define  A'l  similarly,  starting  with  the  requirement  that  A'l  contain  J.  and  extending 
Ki  to  the  left  if  necessary  in  the  same  way  we  constructed  Kq,  Next,  to  construct  K2  we  first 
require  that  it  contain  the  largest  original  gap  (choose  any  one  in  case  of  a  tie)  not  contained 
in  Kq  U  A’l  (if  no  such  gap  exists,  we  leave  K2  undefined  and  let  5  be  the  complement  of 
Ko  U  Ai.)  Then  we  extend  it  it  on  both  the  left  and  right  in  the  same  manner  as  before, 
but  considering  only  gaps  that  are  at  most  as  large  as  the  one  we  started  with,  to  obtain  the 
endpoints  of  A'2.  We  next  start  with  the  largest  original  gap  not  contained  in  Kq  U  Ki  U  A2, 
proceeding  similarly  to  define  A'3,  and  so  forth.  Any  given  original  gap  must  eventually  be 
contained  in  some  A'„  because  there  can  be  only  finitely  many  original  gaps  that  are  as  large 
or  larger  than  the  given  one.  We  do  not  yet  know  that  the  Kn  are  disjoint  from  each  other; 
this  .will  follow  when  we  prove  (3.1),  though. 

Let  us  now  examine  our  construction  more  closely.  Define  /(/)  and  r{I)  to  be  respectively 
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the  left  and  right  endpoints  of  an  interval  1.  For  a  given  Km  let  Go  be  the  gap  we  started 
with  in  its  construction,  which  for  n  >  2  must  be  the  largest  original  gap  it  contains  (or  at 
least  tied  for  the  largest.)  For  simplicity  we  assume  here  that  Go  is  a  gap  of  Si.  Consider 
the  collection  E  of  all  J„  with  |J„|  <  |(7o|i  r(Jn)  >  and  d{Go,Jn)  <  i\Jn\-  We  cljum 

that  the  members  of  E  (if  any)  are  increasing  in  size  from  left  to  right.  If  Jmj  Jn  ^  E  with 
Jm  to  the  left  of  Jm  then  since  r(J„)  <  r(Jn),  it  follows  that  d{Jm,Jn)  <  d{Go,Jn)  <  t\Jn\. 
Since  t  <  T2  and  d{Jm,Jn)  >  72nim(|Jm|,|J„|),  it  must  then  be  the  case  that  |Jnl  > 

Thus  if  E  is  not  empty,  it  must  have  a  rightmost  member,  which  we  call  Gi  (notice  that 
Gi  is  also  the  largest  member  of  E.)  If  E  is  empty,  we  let  Gi  be  empty,  but  in  order  to 
facilitate  future  formalism,  we  define  |(?i|  =  0  and  r(Gi)  =  r{Go)-  One  must  keep  in  mind 
this  degenerate  case  in  verifying  the  assertions  and  formulas  that  follow. 

We  likewise  define  Gj  to  be  the  rightmost  gap  of  Si  which  is  at  most  as  large  zs  Go  and 
lies  within  t  times  its  length  of  Gi\  again  if  no  such  gap  exists  with  r{G2)  >  r{Gi)  we  say 
that  IG2I  =  0  cind  r[G2)  =  ^{<^1)-  Next,  to  define  Go  we  consider  only  gaps  which  are  at 
most  as  large  as  Gi,  for  G4  we  look  only  at  gaps  no  larger  than  G2,  and  so  forth.  Define 
G_i,G_2,  ...similarly  to  be  the  leftmost  (and  largest)  gaps  added  to  /v„  at  each  stage  of 
the  process  of  extending  Kn  leftward.  Then  we  may  think  of  the  open  interval  as  being 
defined  by 

1{K.)=  lim  /(G,n), 

00 

r(/if„)  =  liin  r(Gm). 

TTl-^OO 

Each  limit  exists  because  it  is  the  limit  of  a  bounded  monotcnic  sequence. 

In  the  above  construction,  the  even-numbered  Gm  are  gaps  of  S\  and  the  odd-numbered 
ones  are  gaps  of  52,  but  if  Go  had  been  a  gap  of  S2  it  would  be  the  other  way  around. 
In  any  case.  Go  is  the  largest  even-numbered  Gm  and  either  G\  or  G_i  is  the  largest  odd- 
numbered  one.  Also,  the  even-numbered  Gm  decrease  monotonically  in  size  as  one  moves 
either  rightward  or  leftward  from  the  largest,  and  the  same  statement  holds  for  the  odd- 
numbered  Gm.  We  call  a  given  Gm  either  a  ‘T-gap”  or  “2-gap”  of  Kn  according  to  whether 
it  is  a  gap  of  S\  or  52-  Notice  that  not  all  original  gaps  contained  in  Kn  are  Tgaps  or 
2-gaps,  only  those  that  have  been  given  a  label  Gm  in  the  construction  of  Kn-  When  we  refer 
henceforth  to  left-to-right  ordering  or  adjacency  among  the  l-gaps  and  2-gaps  of  a  given  /fn, 
it  is  with  respect  to  the  ordering  ...,  G_2,G_i,Go,Gi,G2,  —  (Thus,  for  instance,  Tgaps 
can  only  be  adjacent  to  2-gaps  and  vice-versa.) 

The  following  lemma  will  be  used  in  bounding  both  the  numerator  and  denominator  of 
the  left  side  of  (3.1).  It  establishes  for  all  m  >  0  a  bound  on  how  far  Kn  can  extend  to  the 
right  of  Gm  in  terms  of  how  far  Gm+i  extends  past  Gm,  and  similarly  for  m  <  0  on  the  left. 
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Lemma  4  Assume  t  <  (tiTj  —  1)/(ti  +  t2  +  2).  Let 

(ri-t){T2  +  l) 


and 


<Ti  = 


a2  = 


(n  -  0(T2  -  0  -  (1  +  0^ 

{72  -  0(n  +  1) 


(t-1  -  0(72  -  0  -  (1  +  0^' 

Lei  C  be  a  1-gap  of  Kn  which  is  at  least  as  large  as  all  1-gaps  of  Kn  to  its  right.  Let  H  he 
the  next  2-gap  of  Kn  to  the  right  ofG.  Then 


r(K.)  -  r(G)  <  .7j(r{if)  -  r(G)). 


The  same  statement  with  “1”  and  “2”  interchanged  holds,  as  do  the  corresponding  results 
for  left  endpoints. 


Proof  Let  I  be  the  next  1-gap  of  Kn  to  the  right  of  G.  Then  since  |/|  <  \G\, 


Ti|/|  <  d{G,l)  <  d{H,I)  +  r{H)  -  r{G)  <  t\I\  -f  r{H)  -  r{G). 
which,  because  t  <  Tj,  implies  that  |7|  is  bounded  above  by  {r{H)  —J'{G))/{n  —  0-  Hence 
r(I)  -  r{H)  <  |7|  +  d(H,l)  <  (1  +  ()|7|  <  -  r(G)).  (3,2) 

Ti  -  t 

Likewise  the  next  rightward  2-gap  of  Kn  extends  at  most  ((1  -f  t)/{T2  -  t)){r{I)  —  r{H)) 
beyond  7,  and  by  induction 

r{Kn)-r{G)  =  r{H)-r{G)  +  r{I)-r{H)  +  --’ 


< 


i+^  + 

Ti-t 


1  t  1  ^ 

Tx—tT^  —  t 


(v(H)  -  r(G)) 


=  ,r,{r(77)  -  r(G)). 


The  geometric  series  converges,  and  the  denominator  of  cz  is  positive,  because  of  our  as¬ 
sumption  that  t  <  (rir2  -  l)/(ri  4-  r2  -f  2).  I 

The  next  lemma  builds  on  Lemma  4  to  obtain  a  positive  lower  bound  on  the  distance 
between  a  given  Km  and  Kn,  provided  we  can  find  a  1-gap  of  Km  and  a  2-gap  of  Kn  which 
are  respectively  larger  than  all  1-gaps  and  2-gaps  between  them.  The  proof  is  difficult  and 
will  be  handled  later. 


Lemma  5  There  exists  a  function  ipt{Ti,T2)  lhat  is  positive  whenever  (71,72)  is  in  region  C 
and  t  is  sufficiently  small,  and  for  which  the  following  statement  holds.  For  m  ^  n,  let  G  be 
a  1-gap  of  Km  and  H  be  a  2-gap  of  Kn-  If  all  1-gaps  of  Km  or  Kn  with  at  least  one  endpoint 
between  the  closures  of  G  and  H  are  bounded  and  at  most  as  large  as  G,  and  all  similarly 
situated  2-gaps  are  bounded  and  at  most  as  large  as  H,  then 


d{Kn,Km)  >  0t(7i,72)d(G,i7). 
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Figure  8;  Ctises  in  the  proof  of  (3.1) 

Recall  that  to  construct  Kq  and  Ki,  we  chose  /.  and  J.  to  satisfy  the  above  hypotheses. 
Thus  we  now  know  that  Kq  and  K\  are  disjoint  and  separated  by  a  positive  dista;ice  (which 
is  at  least  t/)j(ri,  -  ,)  times  the  distance  between  I.  and  J..) 

Now  suppose  0  <  n  <  m  and  m  >  2;  we  will  prove  (3.1)  by  finding  a  G  and  H  which 
satisfy  the  hypotheses  of  Lemma  5.  Assume  without  loss  of  generality  that  lies  to  the 
left  of  Kri-  Let  I  be  the  largest  original  gap  in  Krn]  say  /  is  a  1-gap.  If  all  1-gaps  of  Kn  are 
smaller  than  /  (Case  1  of  Figure  8),  let  H  be  the  largest  original  gap  in  Kn-  Since  m  >  n, 
Kn  was  constructed  before  A'„,  so  H  must  be  at  least  as  large  as  I,  and  thus  is  a  2-gap. 
Let  G  —  I\  then  G  and  H  satisfy  the  hypotheses  of  Lemma  5.  Also,  d{G,H)  >  i|G|,  since 
otherwise  G  would  have  been  included  in  the  construction  of  K„.  If  on  the  other  hand  there 
are  1-gaps  of  Kn  which  are  at  least  as  large  as  /  (Cases  2  and  3  of  Figure  8),  let  J  be  the 
closest  such  gap  to  /.  Consider  all  2-gaps  of  Km  or  K,,  to  the  left  of  J;  let  K  be  the  largest 
such  2-gap  (any  one  will  do  in  case  of  a  tie.)  Notice  that  K  must  be  adjacent  to  /  or  J.  If  K 
is  in  Kn  (Case  2),  let  G  =  /  and  H  —  K\  then  G  and  H  satisfy  the  hypotheses  cf  Lemma  5, 
and  d{GfH)  >  tjGI  because  G  was  not  included  in  Kn-  Otherwise  (Case  3),  let  G  =  K  and 
H  =  and  reverse  the  indices  “1”  and  “2”.  Once  again,  G  and  H  satisfy  the  hypotheses 
of  Lemma  5  and  d(G,  H)  >  t|Gl.  Notice  also  that  in  all  cases,  G  is  the  largest  1-gap  of  Km^ 
and  H  is  at  least  as  large  as  all  2-gaps  of  Km- 

We  now  estimate  how  large  Km  can  be.  Let  /  and  J  be  the  2-gaps  of  Km  adjacent  to  G 
on  its  left  and  right,  respectively.  Since  I  is  at  most  as  large  as 

r2\I\  <  d{I,  H)  <  d{U  G)  -b  \G\  -f  d{G,  H)  <  t\I\  +  1G|  -f  d{G,  H), 
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or  in  other  words 

|/|<-^{|G|  +  d(G,ff)).  (3.3) 

T2  —  t 

The  same  bound  holds  also  for  J,  so  by  Lemma  4, 


|/ir„l  =  |G|  +  ;(G)  -  w  +  K/u  -  r(G) 

<  |G|  +  £r,(i(G)  -  1(1))  +  <!MJ)  -  <G)) 

<  |G|  +  <t,(i+()(|/|  +  |J|) 

^  |G|  +  2^2j^(|G|  +  <J(G,  ¥)) 

S  (t 


(ti  -  0(r2  -  0  +  (1  +  0^(27-i  +  1) 


d{G,H). 


If  on  the  other  hand  G  is  a  2-gap  and  H  is  a.  1-gap,  we  obtain  the  same  bound  as  (3.4), 
but  with  the  indices  “1”  and  “2”  interchanged.  Then  in  either  case, 

ir.-  ,  ^  (ti -i)(r2-0  +  (l  +  0^(2max(ri,r2)  +  l) 

- - t((r,-t)(r,-t)-  i-.+m - 

Finally,  by  Lemma  5, 

d(Km,Kn)  ^  t{{Ti  -t){T2-t)-{\  +  0^)V>t(ri ,  T2)  g. 

\I<m\  ~  (n  -  f)(r2  -  0  +  (1  +  0^(2max(Ti,T2) -f  !)■ 


The  right  side  of  (3.5)  is  positive  as  long  as  t  is  between  0  and  (rir2  -  1)/(t'i  +  r2  -f  2),  and 
V<('^i)'^2)  >  0)  S'ltd  goes  to  zero  when  t  approaches  any  of  these  borderline  values.  Therefore 
the  right  side  of  (3.5)  attains  a  maximum  value,  call  it  -,^('ri,  72),  at  some  allowable  value  of 
t,  say  t,.  We  thus  carry  out  the  construction  of  S  with  i  —  t.\  then  (3.1)  holds,  and  the 
proof  is  complete.  I 

Let  i/>(ri,r2)  =  i/’t.(Ti, 72);  then 

(  )  =  ^-((^1  -  t>){T2  +  ^.)^)0(7i,  72) 

^  in  -  t.){T2  -  <.)  +  (1  +  <.)2(2max(ri,Tj  +  1)' 


Remark  We  will  see  in  the  proof  of  Lemma  5  that  ^^(71,72),  and  hence  'p{ti,T2),  must  be 
very  small  when  (71,72)  is  near  the  boundary  of  region  C.  However,  if  both  and  T2  are 
large  and  t  is  small  compared  with  the  two  thicknesses,  it  is  not  hard  to  check  that  ?i’t(7i,72) 
is  close  to  one.  Then  2/71,72  1,  one  finds  that  t^  is  of  order  min(ri ,  72),  whence  fp{Ti,T2) 

is  of  order  •^min{Ti,T2)  also.  Thus  when  the  thicknesses  of  Si  and  S2  are  large,  the  lower 
bound  we  obtain  on  the  thickness  of  S  is  reasonably  large. 
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1 


.  Go  . 
5i:  ^ . ^ 


G2 


52: 


-yo— 


-yi- 


h-'H 

— Xo- 


Figure  9:  The  gaps  G,-  and  Hi 


We  now  prove  our  main  technical  lemma. 

Proof  of  Lemma  5  Let  G  be  a  1-gap  of  Km  and  be  a  2-gap  of  Kn  satisfying  the 
hypotheses.  We  assume  without  loss  of  generality  that  ri  >  r2;  then  by  (1.1)  the  condition 
6  G  implies 

n  >  w)  =  - 


and 


T2‘ 


(2ri  -f  1)^ 
r2  >y(ri)  = - - . 


(3.6) 


(3.7) 


If  d(G,  H)  =  0,  the  inequality  to  be  proven  is  trivial.  Otherwise,  let  us  normalize  d(G,  H)  to 
be  one,  and  assume  G  lies  to  the  left  of  H,  Let  Go  =  G  and  Hq  =  H.  Let  G\  be  the  1-gap  of 
Kn  adjacent  to  Hq  on  its  left,  auu  let  H\  be  the  2-gap  of  Km  adjacent  L  Go  on  its  right.  Let 
G2  be  the  adjacent  1-gap  of  Km  rightward  from  i/i,  and  likewise  define  H2)Gz^Ho,  .  ..(see 
Figure  9.)  For  i  >  0  let 


Xi  = 


and 


Vi  = 


/(//.) -/(G.+i) 

i  even 

r{Gi+x)  -  r{Hi) 

i  odd 

r{Hi+i)  -  r(G,) 

i  even 

l{Gi)  -  /(i/,>:) 

i  odd. 

Let  Ri  -  d{Gi,  Lf,);  then  Rq  =  1  and  R,+i  =  max(i7,  -  x,  -  y,,  0)  for  i  >  0.  Let  Roo  be  the 
limit  as  i  goes  to  infinity  of  Ri.  Then  d{Km,Kn)  =  R<x>t  so  we  wish  to  show  that  there  is  a 
positive  lower  bound  on  which  depends  only  on  ri,r2,  and  t. 

In  the  same  way  as  we  obtained  (3.2)  it  follows  that  for  all  i, 


and 


1  +  t 

i.+i  < - ryt 

Tj  —  { 

(3.8) 

.  l+t 

Vi+I  < 

T2  —  t 

(3.9) 

Furthermore,  by  Lemma  4  we  have  that 

Vi  -j-  X{+j  -f  j/,-+2  -f 


<  <^2yi 
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and 


Xi  +  Vi+i  +  x,+2  +  •  •  •  < 


Thus,  for  each  i, 

■Roo  >  -Ri  -  a;,-  -  y{  -  x,+i  -  yt+i - >  Ri-  (3.10) 

We  will  show  that  for  some  i,  the  right  side  of  (3.10)  is  positive. 

Next  let  us  obtain  upper  bounds  on  xq  and  t/o-  We  know  that 

xo  =  l{Ho)  -  l{Gi)  <  |Gi|  +  d{Gi,  Ho)  <  (1  +  OIGil,  (3.11) 

and  by  hypothesis  |Gil  <  |Go|,  so 

xo  =  l{Ho)  -  r{Go)  -  (/(C?i)  -  r{Go))  -  1  -  d{Go,Gi)  <  1  -  ri|Gi|.  (3.12) 


Eliminating  |Gi|  from  these  inequalities  yields 


Ti  +  1  +  t  ’ 


(3,13) 


Similarly, 


yo  ^  7;Trrf 

We  can  obtain  similar  bounds  on  x,  and  y,  for  i  >  1,  but  the  bounds  are  complicated  by  the 
fact  that  we  do  not  know  in  general  that  |Gj+i|  <  |G,'|  (or  |//|+i|  <  |^^t|).  The  analogues  of 
(3.11)  and  (3.12)  are  thus 

Xf  <  (1  +  01<^i+ll 


X,-  <  R{  -  Ti  min(|G,|, \Gi^i\). 


If  |G,+i|  <  |G,1,  then  as  in  (3.13)  it  follows  that 


o.  c  —lil—ff. 

Tx  +  l+t 


If  |Gf+i|  >  |G,|,  then  by  (3.15), 


Xi  <  Ri  -  ti|G,-|  <  Ri  - 

i>  i  t' 


(3.15) 


(3.16) 


(3.1T) 


If  (3.16)  fails,  then  using  (3.17)  together  with  the  negation  of  (3.16),  one  finds  that  x,_i  is 
bounded  above  by  the  right  side  of  (3.16).  Thus  regardless  of  the  relative  lengths  of  G,  and 

Gi+i , 

min(x;,x,-_i)  <  — (3.18) 

Vj  +  i  + 1 
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for  z  >  1.  Likewise,  regardless  of  the  relative  lengths  of  Hi  and  we  have  for  alH  >  1 
that 


min(y.-,t/,-_i)  < 

Let  Qi  =  Xi/Ri  and  6,'  =  yi/Ri  provided  R{  >  0;  then 

Ri+i  =  iTiax(l  —  a,-  -  6,-, 

Thus  a, -4.1  and  bi+\  are  defined  as  long  as  1  —  a,-  —  b{  >  0.  For  ;  =  1,2  let 

A-  =  -i±i- 


(3.19) 


(3.20) 


N  = 


1  -f*  t 

Tj-t' 


The  conditions  (3.13),  (3.14),  (3.18),  and  (3.19)  can  then  be  written 

Go  <  Ai, 


and 


mm  a,-+i. 


min  ^{4*1 ) 


bo  <  A2, 

_ ^ _ 

1  -  a,'  -  bi 

bj  ' 
1  -  a,  -  6,' 


^  A2. 


Also,  conditions  (3.8)  and  (3.9)  become 


and 


fli+l  <  Ml 

^«+x  ^  M2 


bi 


1  -  a,-  -  bi 

a.- 


1  -  a,-  -  bi  ■ 

Finally,  our  objective  is  to  show  that  for  some  z, 

1  —  cTiQi  —  a2bi  >  0, 


(3.21) 


(3.22) 

(3.23) 


which  implies  that  the  right  side  of  (3.10)  is  positive. 

We  observe  that  0,4.1  and  6,4.1  are  defined  at  least  as  long  as  a,  <  Ai  and  6,  <  A2,  because 
then 


1  —  a,  —  6;  >  1  —  Ai  —  At 

T1T2  -  (1  +  t)^ 

(Ti  +  f  T  1)(T2  +  f  +  1) 
(Ti-t)(r2-0-(l+0^ 
(ri  +  f  +  l)(r2  +  <  +  1) 

>  0 
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(since  t  <  (rir2  -  l)/(ri  +  +  2).)  Also,  as  long  as  a,-  <  Ai,  by  (3.22)  we  have 

/Z2Ai 


Let 


Mi)- 


1  —  Ai  —  hi 
IJ.2^1 


1  -  Ai  -  i' 

The  equation  h{b)  =  i  has  two  solutions, 

1  —  Ai  ±  \f{l  —  Ai)^  —  4//2'^i 
_  , 

and  if  the  roots  are  real,  then  h{b)  <  i  for  i_  <  i  <  i+  (this  can  be  verified  by  checking  the 
value  6  =  (1  -  Ai)/2.)  We  claim  that  for  t  sufficiently  small,  b±  are  real,  with 


i4.= 


i+  >  A2 


(3.24) 


and 

1  —  <7iAi  —  cT2i_  >  0.  (3,25) 

Let  us  delay  the  verification  of  this  claim  until  the  end  of  the  proof.  Choose  6.  >  6...  with 
1  -  cr^Ai  -  (Tib,  >  0.  Now  60  <  A2  <  i+,  and  as  long  as  a,'  <  A-  continues  to  hold, 
ii+i  <  i(ii)  <  i«  for  i/  6  (i-,i+).  Then  eventually  i,'  <  i„  and  furthermore  since  b  -  h{b) 
must  have  a  positive  minimum  value  on  (i.,  A2]  (if  6.  >  A2  then  io  <  i.  already)  there  is  a 
maximum  number  N  (depending  only  on  ti,  r2,  and  t)  of  iterations  it  can  take  before  6,'  <  b„ 
We  therefore  have  shown  that  if  a,  <  Ai  for  i  <  N,  then  6,'  <  b.  for  some  i  <  iV,  and  hence 

1  -  c\ai  -  (Tibi  >  1  -  ctjAi  -  (Tib.  >  0.  (3.26) 


If  on  the  other  hand  a,+i  >  Ai  for  some  i  <  .V,  then  let  i  be  the  smallest  index  for  which 
this  occurs.  We  claim  that  then  (3.23)  holds  for  i.  By  the  results  of  the  previous  paragraph. 
bi  <  6,_i  <  •  •  •  <  60  <  A2.  Also,  by  (3.21),  a,-  <  Ai(l  -  a<  -  6,),  or  in  other  words 


a,-  < 


1  -}■  Ai 


■(1  -  bi). 


Then 


Now  when  t  =  0, 


1  -  <7ia,'  —  (Tibi  >  1  — 


1  +  Aj 


triAi  \ 
1  +  -^1/ 


bi. 


t^iAi  _  (ti  +  1)t2  _  Ti(r2  +  1) 

1  +  Ai  TxTi  -  1  (ti  +  2)(rir2  -  1) 
_  ri(nT2  -  1)  +  2riT2  +  2x2 
(n  +  2)(rir2  -  1) 

>  0, 
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and  thus  for  t  sufficiently  small  it  remains  positive.  Then  since  6,-  <  A2, 


1  -  (Tio,-  -  0-26, •  >  1 - - - 0-2  - 

1  •{  Ai  V 


CTjAi  f  CTlAi 

1-1  Ai  i  +  Ai 

1  —  a2A2  —  (1  —  A2)  2^’ 


When  t  =  0,  by  (3.6) 


i  —  CT2A2  =  1  "■ 


I  (n  -f  1)7-2 
(T2  +  l)('i"iT2  —  1) 
-2T2  -  1 
{7-2  +  l)(rir2  -  1) 
r2^  +  3x2  -H  -  2X2  -  1 
(t2  -r  i)(Tir2  -  1) 

7-2 

^  ) 

7-1  r2  -  1 


while 


(3.27) 


f’  _  A  -  —H _ 7-i(t2  -h  1)  _  Ti  ^  7-2 

^  ^  1  +  Ai  r2  +  1  (n  +  2)(Tir2  -  1)  n  +  2  riT2  -  1’ 

so  v’.e  right  side  of  (3.27)  is  positive  for  t  =  0,  It  therefore  remains  positive  for  t  sufficient! 
small. 

To  summarize,  we  have  shown  that  if  t  is  sufficiently  small,  then  for  some  i  <  N,  either 

(3.26)  or  (3.27)  holds.  The  right  side  of  each  of  these  equations  is  positive  and  depends 
only  on  tj,T2,  and  t.  Furthermore,  aj  <  Aj  and  bj  <  X2  for  j  <  i,  so  by  (3.20),  Rj+i  > 
(1  -  Ai  -  X2)Rj,  and  hence  Ri  >  (1  -  Aj  -  A2)'.  Then  by  (3.10), 


R'^o  >  ^.(1  -  -  (Tot,)  >  (1  -  Ai  -  A2)^'(1  -  c'ja,-  -  ajii), 


where  1  -  cria,  -  aob,  is  in  turn  bounded  below  by  the  lesser  of  the  right  sides  of  (3.26)  and 

(3.27).  We  have  therefore  shown  for  t  sufficiently  small  how  to  obtain  a  positive  lower  bound 
on  Roo  which  depends  only  on  rj,r2,  and  t\  we  let  T/>((rj,r2)  be  this  lower  bound. 

It  remains  for  us  to  verify  (3.24)  and  (3.25).  We  again  show  they  are  true  for  t  =  0, 
whence  they  hold  for  t  sufficiently  small  by  continuity.  When  t  =  0, 

b± 


Now  by  (3.6), 

7-1^2^  -  4(ri  +  l)r2  =  ti(tiT2^  -  4t2)  -  4r2 


7-i/(n  +  1)  ±  \/7-iV(ti  +  1)2  -4/((ri  +  1)72) 

2 

^17-2  ±  \/7'i^r2^  -  4(ti  +  1)7^ 

2(Ti  +  1)72 


(3.28) 
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>  Ti{T2^  Tj  +  1)  -  4X2 

(T2^  +  3X2  +  1)(T2^  ~  X2  +  1)  ~  4T2^ 

r2^ 

(X2^  -  X2  -  1)^ 


(3.29) 


Thus  b±  axe  real  and  distinct  (and  the  same  must  then  hold  for  t  sufficiently  small.)  Next 
by  (3.28), 

-  ~ 

2x2(1  +  l/xi) 

from  which  we  see  that  6+  is  increasing  as  a  function  of  Xi.  Thus  6+  is  greater  than  the  value 
it  would  take  on  if  (3.6)  were  an  equality,  which  owing  to  (3.29)  means 


,  (X2^  +  3X2  +  1)/X2  +  |X2^  -  X2  -  1|/X2 

+  2(2X32+3X2  +  1)/X2 

>  ^2^  4-  3X2  +  1  -  (X2^  -  X2  1) 

2(X2  +  1)(2X2  +  1) 

1 

T2  +  I 

=  A2. 


Hence  (3.24)  holds  for  t  0,  and  consequently  for  t  sufficiently  small. 
When  f  =  0,  (3.25)  can  be  written 

b  <  ^  -  2xi  -  1 

(Ti  “  (ti  + 1)2X2 

The  right  side  of  (3.30)  is  an  increasing  function  of  X2,  and  since 


n  4(xi  +  1)/X2 

2(n  + 1) 

6_  is  a  decreasing  function  of  X2.  Then  by  (3.7), 


xi  -  Jti^  -  4xa3(xi  +  l)/(2xi  +  1)2 

ri((2xi  +  1)  -  ^(2xx  +  l)2-4(xi2  +  xi) 

2(xi  +  l)(2xi  +  1) 


(xi  +  l)(2xi  +  1)  ’ 

while 

Xi2x2  -  2xi  -  1  (2xi  +  l)2/xi  -  (2X1  +  1) 

(xi  +  1)2X2  ^  (xi  +  l)2(2xi  +  l)2/xi3 


(3.30) 
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ri^(2ri  +  1  -  n) 

(n  +  i)2(2n  + 1) 

(n  +  1)(2ti  +  i)  ■ 

Thus  (3.25)  holds  for  <  =  0,  and  for  t  sufficiently  small.  The  proof  of  Lemma  5  is  now 
complete.  I 

4  Intersecting  Three  or  More  Cantor  Sets 

In  proving  Theorem  1,  we  chose  a  subset  5  of  S\  0S2  in  order  to  guarantee  positive  thickness. 
In  this  section  we  demonstrate  that  positive  thickness  sets  are  in  some  sense  generic  in  S\f\S2> 
We  also  explain  how  Theorem  1  is  useful  in  finding  conditions  under  which  three  or  more 
Cantor  sets  must  have  a  nonempty  intersection. 

The  set  S  we-  constructed  in  Section  3  need  not  be  dense  in  Sx  n  nor  even  in  the 
non-isolated  points  of  3x0  32,  However,  there  are  subsets  of  Sx  0  52  with  thickness  at  least 
near  ?.ay  accumulation  point.  To  see  this,  let  {g„}  be  a  sequence  of  distinct  points 
in  Sx  n  S2  which  converge  to  a  point  q.  It  is  not  hard  to  si  jw  that  within  any  neighborhood 
N  of  q  there  are  compact  subsets  Tx  C  Sx  and  22  C  5:,  each  of  which  contains  all  but  finitely 
many  with  t{Tx)  >  t{Sx)  and  T{r2)  >  t(52).  Notice  that  any  two  compact  sets  which 
intersect  in  three  or  more  points  must  be  interleaved.  Thus  Tx  and  r2  are  interleaved,  and 
by  Theorem  1  their  intersection  contains  a  set  with  thickness  at  least  ^(tj,  T2).  We  conclude 
that  arbitrwily  near  any  non-isolated  point  of  Sx  H  S2  there  are  subsets  of  Si  H  S2  which 
have  thickness  at  least  <^(^11 T2). 

In  addition  to  showing  that  there  are  many  subsets  of  5i  D  S2  with  positive  thickness, 
it  is  possible  to  obtain  a  lower  bound  on  the  diameter  of  the  positive  thickness  subset  5  of 
Si  n  S2.  If  the  two  sets  Si  and  S2  are  interleavod  in  such  a  way  that  neither  is  contained 
in  the  convex  hull  of  the  other,  then  by  the  discussion  following  the  statement  of  Lemma  5, 
the  diameter  of  S  is  at  least  ^{tx,T2)  times  the  length  of  overlap  between  the  convex  hulls  of 
Si  and  S2.  Since  the  thickness  of  S  is  at  least  v’(Ti,r2),  we  immediately  have  the  following 
result. 

Corollary  6  Let  Sx  and  S2  be  two  interleaved  compact  sets  whose  thicknesses  (ri,r2)  lie  in 
region  C  and  for  which  the  intersection  Q  of  their  convex  hulls  contains  neither  Sx  nor  S2. 
If  S3  is  a  compact  set  with  largest  bounded  gap  G  such  that 


(i)  the  hull  of  S3  contains  Q, 

(ii)  1G|  <  ti’(ri,T2)lQ| 

(iii)  T(S3)¥’(Ti,r2)  >  1, 
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then  Si  0820  S3  is  nonempty. 

We  note  that  if  instead  of  condition  (iii)  we  required  the  pair  and  <^(^11^2)  to  lie 
in  C,  then  5x0  52  0  S3  would  contain  a  set  of  thickness  at  least  Thus 

one  can  inductively  find  thickness  conditions  guaranteeing  the  nonempty  intersection  of  any 
finite  (or  even  countably  infinite)  number  of  compact  sets,  although  the  analogue  of  the 
interleaving  condition  gets  more  complicated. 

If  (tij  T2)  is  sufficiently  far  from  the  boundary  of  region  C,  then  as  discussed  in  the  remark 
preceding  the  proof  of  Lemma  5  it  is  not  hard  to  obtain  explicit  lower  bounds  on  ^{tx,T2) 
and  tf»(Tj,r2).  In  particular,  for  tj  and  T2  large  we  found  that  (^(ri,r2)  is  at  least  of  order 
ymin(rx,r2),  and  tf’(ri,r2)  is  approximately  one. 

We  thank  the  referee  for  a  thorough  reading  of  our  paper  and  many  helpful  comments. 
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ABSTRACT.  We  examine  bifurcation  phenomena  for  maps  that  are 
piecewise  smooth  and  depend  continuously  on  a  parameter  p.  In  the 
simplest  case  there  is  a  surface  F  in  phase  space  along  which  the 
map  has  no  derivative  (or  has  two  one-sided  derivatives).  F  is  the 
border  of  two  regions  in  which  the  map  is  smooth.  As  the  parameter 
H  is  varied,  a  fixed  point  E  may  collide  with  the  border  F,  and 
we  may  assume  that  this  collision  occurs  at  ^  -  0.  A  variety  of 
bifurcations  occur  frequently  in  such  situations,  but  never  or 

almost  never  occur  in  smooth  systems.  In  particular  E  may  cross 

*  ^ 

the  border  and  so  will  exists  for  p  <  0  and  for  p  >  0  but  may  be  a 
saddle  in  one  case,  say  p  <  0,  and  may  be  a  repellor  for  o. 

For  p  <  0  there  can  be  a  stable  period  two  orbit  which  shrinks  to 
the  po'nt  Eq  as  /i  ->  0 ,  and  for  p  >  0  there  may  be  a  stable  period 
3  orbit  which  similarly  shrinks  to  Eq  as  ^  0.  Hence  one  observes 

the  following  stable  periodic  orbits:  a  stable  period  2  orbit 
collapses  to  a  point  and  is  reborn  as  a  stable  period  3  orbit,  'vo 
also  see  analogously  ’’stable  period  2  to  stable  period  p  orhir 
bifurcations",  with  p  =  5,  ll,  52,  or  period  2  to  quasi-per ion : ' 
or  even  to  a  chaotic  attractor.  We  believe  this  phenomenon  will  be 
seen  in  many  applications. 


1.  INTRODUCTION 

Certain  bifurcation  phenomena  have  been  reported  repeatedly  in 
numerous  studies  of  low  dimensional  dynamical  systems,  that  depend 
on  one  parameter.  The  rather  familiar  bifurcation  phenomena 
describing  the  evolution  of  attractors  as  a  parameter  is  varied 
include  the  saddle  node  bifurcation,  the  period  doubling  (or 
halving)  bifurcation,  and  the  Hopf  bifurcation.  In  the  literature 
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dealing  with  bifurcation  theory,  it  is  frequently  assumed  that  the 

map  corresponding  to  the  dynamical  System  is  differentiable;  see 

for  example  [GH],  [K],  [RJ,  or  (SJ.  To  remind  the  reader  so  that 

we  may  draw  contrasts,  the  well  known  bifurcation  diagram  of  the 

2 

quadratic  map  =  p  -  x  is  given  in  Figure  1  (1  <  p  <  l.o). 

All  the  computer  assisted  pictures  were  made  by  using  the  DYNAMICS 
program  [Y]. 


FIGURE  1 


We  say  a  map  is  smooth  if  the  map  has  a  continuous  derivative. 

A  region  is  a  closed,  connected  subset  in  phase  space.  We  examine 

continuous  maps  which  are  piecewise  smooth.  We  restrict  attention 

to  those  which  are  smooth  on  two  regions  of  the  plane  with  the 

border  between  these  regions  being  a  smooth  curve.  From  now  on  we 

assume  that  there  is  a  smooth  curve  f  which  separates  the  plane 

into  two  regions  denoted  by  R.  and  R_.  We  say,  a  map  F  from  th° 

A  D 

2 

phase  space  [R“  to  itself  is  piece  wise -smooth  if  (1)  F  is 
continuous,  and  (2)  F  is  smooth  on  both  the  regions  and  . 

Note  that  on  the  border  F  between  the  regions,  the  mappings  musr 
be  equal  since  F^  is  assumed  to  be  continuous.  A  special  case  fnat 

we  shall  refer  to  frequently  is  the  following  prototype  example,  i 

piecewise  linear  map  into  which  other  generic  piecewise  linear 
maps  in  the  plane  can  be  transformed  by  changes  in  coordinates. 

Let  u  and  w  be  vectors  in  the  plane.  Let  x  and  y  be  the  phase 
space  coordinates  and  p  is  a  scalar  parameter.  Let  be  the  map 
defined  by 

P(x,y)  =  XU  +  |x|w  +  (y  +  p)(l,Q) 

r* 

and  we  investigate  trajectories  ^ ^ 

regions  R^  and  Rg  are  the  left  and  right  half  plane  separated  by 


2 


Figure  1. 

2 

Bifurcation  diagram  of  the  quadratic  map  ^  •  The 

parameter  fj  (plotted  horizontally)  varies  from  1  to  1.5,  and  x  is 
plotted  vertically,  -1^x52. 


r,  the  Y-axis. 

To  illustrate  the  "period  two  to  period  three"  border-collision 
bifurcation  phenomenon,  consider  the  one-parameter  family  of  maps 
f  (-00  <  /j  <  oo)  from  the  plane  to  itself,  defined  by 

(-1.4x  +  y,  -O.lx)  +  /j(l,0)  if  X  0 

f^(x,y)  =  < 

(-3x  +  y,  -4x)  +  ^(1,0)  if  X  i  0 

Notice  that  the  map  is  smooth  in  each  of  the  half  planes  k  <.  0  and 
X  i  0,  and  the  Y-axis  is  the  border  which  is  a  smooth  curve.  Note 
that  to  write  f  in  the  form  of  P  ,  let  u  =  ( -2 . 2 , -2 . 05 ) ,  and  w  = 

( -0 . 8 , - 1 . 95 > .  The  bifurcation  diagram  exhibiting  the  "period  two 
to  period  three"  bifurcation,  is  presented  in  Figure  2  (-0.1  <  p  < 
0.2).  Ail  the  bifurcation  diagrams  in  this  paper  show  a  projection 
of  the  attractor,  projecting  (x,y)  onto  the  X-axis,  which  is 
plotted  vertically;  the  horizontal  coordinate  is 

FIGURE  2 

The  purpose  of  this  paper  is  to  study  the  occurrence  of  such  a 
new  bifurcation  phenomenon  for  continuous,  piecewise  smooth  maps. 
These  systems  include,  for  example,  two-dimensional  continuous, 
piecewise-linear  maps.  In  [HNS]  the  dynamics  of  a  simple  economic 
model  was  studied,  and  a  "period  three  to  period  two"  bifurcation 
was  observed  numerically,  and  was  established  rigorously  in  (HN) 
for  a  degenerate  piecewise-linear  situation.  The  "border-collision 
bifurcation"  phenomena  is  a  much  richer  class  of  bifurcation 
phenomena  than  just  a  "period  two  to  period  three"  bifurcation  and 
occur  for  generic  piecewise  smooth  maps.  We  present  phenomena  that 
occurs  when  the  nature  of  an  unstable  fixed  point  of  a  piecewise 
smooth  map  is  changed  while  the  fixed  point  collides  with  the 
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Figure  2. 

Bifurcation  diagram  exhibiting  the  "period  two  to  period  three" 
bifurcation  of  the  map 

=  (-1.4x  +  y  +  (i,  -O.lx)  if  x  i  0,  and 
5  (-3x  +  y  +  /j,  -4x)  if  X  >  0, 

The  parameter  y  (plotted  horizontally)  varies  from  -0.1  to  0.2, 
and  the  coordinate  x  is  plotted  vertically,  -1  ^  x  ^  1. 


border  between  two  regions  in  which  the  map  is  smooth.  Since  the 

fixed  point  is  unstable  before  and  after  collision,  it  is  not 

shown  in  the  bifurcation  diagram  in  Figure  2.  While  we  consider 

maps  in  the  plane,  higher  dimensional  analogues  exist.  We  know  of 

no  phenomena  that  can  occur  only  in  higher  dimensional  cases. 

There  is  also  no  difficulty  in  changing  the  notation  to  that  there 

are  more  than  2  regions  on  which  the  map  is  smooth.  We  could  also 

allow  r  to  depend  on  lu,  but  coordinates  could  be  chosen  so  that  it 

remains  fixed,  so  our  case  in  practice  includes  moving  boundaries. 

With  moving  boundaries  the  map  would  be  piecewise  smooth  in  fj. 

We  say,  a  fixed  point  E  is  a  border  crossing  f ixed'  point  if  it 

crosses  the  border  F  between  two  regions  in  which  the  map  is  smooth. 

We  will  assume  that  the  crossing  occurs  at  /i  =  0.  The  fixed  point 

E  is  called  a  flip  saddle  if  tne  eigenvalues  X  and  y  of  the 
M 

Jacobian  matrix  DF  ( E  )  if  X  <  -1  <  y  <  1 •  Assume  that  there 

M  IJ 

exists  a  one-parameter  family  of  piecewise  smooth  maps  and  assume 
that  there  is  a  border  crossing  fixed  point  (or  periodic  point) 

E  ,  we  emphasize  the  case  when  E  crosses  the  border  F  it  changes 

y  y 

from  being  a  flip  saddle  to  a  repellor  with  complex  eigenvalues. 

The  above  example  has  this  behavior. 

In  Section  2,  we  discuss  why  the  border-collision  bifurcation 
phenomenon  occurs  when  the  nature  of  an  unstable  equilibrium 
changes  when  it  crosses  the  border  of  two  regions.  To  be  somewhat 
more  specific,  assume  that  a  border  crossing  fixed  point  (or 
periodic  point)  E  of  a  one-parameter  family  of  piecewise  smooth 
maps  changes  from  being  a  flip  saddle  to  a  repellor  with  complex 
eigenvalues  when  it  crosses  the  border  F.  Then  at  y  =  0 ,  a  border- 
collision-bifurcation  occurs  at  t^is  fixed  point  E^  on  the  border. 
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In  Section  3,  we  mainly  deal  with  two  piecewise  smooth  systems 

of  the  plane,  one  piecewise  linear  and  one  piecewise  nonlinear.  The 

first  system  is  the  map  P  (derived  in  Section  2)  that  corresponds 

M  » 

with  a  generic  piecewise  smooth  nonlinear  map,  and  the  other 
system  is  based  on  the  Henon  map.  For  the  piecewise  linear  map 
we  present  several  examples  including  "period  2  to  period  p"  (p 
=  5,  11,  and  52),  "period  2  to  quasi-periodic"  and  "period  2  to 
chaotic"  bifurcation.  We  also  present  an  example  of  a  border- 
collision  bifurcation  for  the  map  P  in  which  no  attractors  but 
chaotic  saddles  are  involved.  The  system  of  the  plane  involving 
the  Henon  map  at  the  left  side  and  a  linear  map  at  the  right  side 
of  the  border,  different  border-collision  bifurcations  are 
observed.  We  present  a  variety  of  examples.  Although  we  we  do  ^ot 
have  an  exhaustive  list  of  types  of  border-collision  bifurcation 
of  one-parameter  families  of  maps  under  consideration,  we  point 
out  that  several  other  types  of  bifurcation  occur.  We  believe  this 
phenomenon  will  be  seen  in  many  applications. 

In  Section  4  we  prove  that  for  certain  one-parameter  famii.-s 
of  piecewise  smooth  maps  exhibit  a  "period  2  to  period  3"  border- 
collision  bifurcation.  This  phenomenon  persists  under  small 
perturbations  of  the  involved  maps. 

In  Section  5,  we  discuss  the  state  of  the  art,  and  pose  several 
questions  which  remain  unresolved.  This  paper  does  not  give  a 
complete  theory,  but  can  be  considered  as  initiating  a  bifurcation 
theory  of  piecewise  smooth  maps. 
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2  THE  BORDER-COLLISION  BIFURCATION  PHENOMENON 

In  the  bifurcation  theory  for  maps,  attention  is  focused  on 
differentiable  maps  when  one  or  more  eigenvalues  of  a  fixed  point 
(or  periodic  point)  cross  the  unit  circle.  When  this  occurs,  the 
nature  of  the  fixed  point  changes.  For  example,  a  fixed  point 
attractor  becomes  a  saddle  {possibly  a  flip  saddle)  or  a  repellor. 
For  border  crossing  fixed  points,  the  Jacobian  matrix  of  the  fixed 
point  generally  changes  discontinuously ,  and  the  fixed  point  can 
for  example  change  from  being  a  repellor  to  a  saddle  as  /j  crosses 
zero . 

Let  F(‘,^)  =  F  be  a  one-parameter  family  of  piecewise  smooth 

2 

maps  from  the  phase  space  R  to  itself,  depending  smoothly  on  the 
parameter  /j,  and  where  p  varies  in  a  ce^'tain  interval  on  the  real 
line.  Let  E  denote  a  fixed  point  of  F..  defined  on  -t  <  ^  <  c,  for 
some  e  >  0.  For  a  general  approach  (which  is  given  below)  we  need 
the  concept  of  the  "orbit  index"  of  a  periodic  orbit  [MYl.  The 
orbit  index  is  a  number  associated  with  a  periodic  orbit,  ana  Mils 
number  is  useful  in  understanding  the  patterns  of  bifurcations  the 
orbit  undergoes.  We  say  an  orbit  of  period  p  is  typical  if  its 
Jacobian  matrix  exists  (that  is,  the  Jacobian  matrix  of  the  p-th 
iterate  of  the  map  at  a  point  of  the  orbit)  and  neither  +1  nor  -I 
is  an  eigenvalue  (of  the  Jacobian  matrix).  For  typical  orbits,  the 
orbit  index  is  -1,  0,  or  +1.  The  orbit  index  is  a  bifurcation 
invariant  in  the  sense  that  if  one  examines  the  periodic  orbits 
that  collapse  to  the  fixed  point  E  as  -»  0 ,  and  adds  the  orbit 
indexes  of  the  periodic  orbits  that  exist  just  before  a 
bifurcation,  then  that  sum  equals  the  corresponding  sum  just  after 
that  bifurcation.  Suppose  a  typical  periodic  orbit  PO  of  a  map  F 
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has  (minimum)  period  p.  The  orbit  index  of  that  orbit  depends  on 
the  eigenvalues  of  the  Jacobian  matrix  of  the  map  at  one  of 

the  points  in  PO.  Now  we  (define  the  orbit  index  IpQ  of  PO.  Let  m 
be  the  number  of  real  eigenvalues  of  Ap  smaller  than  -1,  and  let 
n  be  the  number  of  real  eigenvalues  of  A^  greater  than  +1.  The 
orbit  index  Ip^  of  PO  is  defined  by 
IpQ  =  0  if  m  is  odd; 

IpQ  =  -1  if  m  is  even  and  n  is  odd; 

IpQ  =  +1  if  both  ra  and  n  are  even. 

If  the  orbit  index  =  -1,  then  the  orbit  is  called  a  regular 
saddle .  The  typical  orbxts  with  orbit  index  +1  in  the  plane  are 
repellors  and  attractors  and  fixed  points  with  non-real 
eigenvalues.  The  def'nition  of  orbit  index  is  technical  when  a 
Pi.int  of  the  orbit  lies  on  the  boundary  and  so  does  not  have  a 
Jacobian  matrix,  and  the  definition  is  unnecessary  since  we 
consider  orbits  for  0 . 

For  a  moment,  assume  that  E  is  in  the  interior  of  the  region 

(or  the  region  Rg)»  and  write  X  and  u  for  the  eigenvalues  of 

DF^(E^).  If  neither  of  the  two  eigenvalues  X  and  v  is  on  the  unit 

circle,  then  the  fixed  point  E  is  called  a  flip  saddle  (and  has 

index  0)ifX<-l<u<l:E  is  a  regular  saddle  (and  has  index 

^  — 

-1)  if  -1  <  p  <  1  <  X;  E  is  a  reoellor  (and  has  index  +1)  if  both 
|x|  >  1  and  |u(  >  1;  and  E^  is  an  attractor  (and  has  index  +1)  if 
both  |x|  <  i  and  |pj  <  1.  Note  that  E^  has  orbit  index  +1  if  the 
eigenvalues  are  not  real.  Hence,  a  typical  fixed  point  is  a  flip 
saddle,  a  regular  saddle,  a  repellor  or  an  attractor.  Similarly, 
the  nature  of  periodic  points  is  defined. 

Now  we  are  able  to  provide  a  definition  of  the  notion  "border- 
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collision  bifurcation".  Let  the  regions  and  R^,  the  map  and 
the  fixed  point  (periodic  point)  be  as  above.  Assume  there 

exists  a  number  e  >  0  such  that  (1)  Eq  is  cn  the  border  of  the  two 
regions  R^  and  Rgi  (2)  for  -e  <  fJ  <  0  the  fixed  point  is  in  the 
region  R^,  and  its  index  is  I^,  and  (3)  for  0  <  ^  <  e  the  fixed 
point  E^  is  in  the  region  Rg,  and  its  index  is  Ig.  If  and  Ig 
are  different,  then  (as  stated  below)  some  bifurcation  must  occur 
at  Eg,  since  the  orbit  index  of  E  is  changing  from  to  Ig, 
while  the  parameter  /i  is  increasing  from  -e  to  +e. 

We  say  a  periodic  orbit  PO  is  an  i so lated  border  crossing  orbit 
if  (1)  PO  includes  a  point  that  is  a  border  crossing  fixed  point 
under  some  iterate  of  the  map,  and  (2)  the  orbit  PO  is  isolated  in 
phase  space  when  (j  s  0,  that  is,  in  the  plane  there  exist  » 
neighborhood  U  of  the  orbit  PO  such  that  PO  is  the  only  periodic 
orbit  in  U  when  n  -  0,  From  the  topological  degree  theory  as 
described  in  (MY)  (see  also  (AYYJ  for  the  two  dimensional  case), 
the  following  "Border-Collision  Bifurcation"  result  follows  after 
some  minor  modifications. 

BORDER-COLLISION  BIFURCATION  THEOREM.  For  each  two-dimensional 
piecewise  smooth  map  and  depending  smoothly  on  a  parameter  if 
the  index  of  an  isolated  border  crossing  orbit  changes  as  /j 
crosses  0,  then  at  p  =  0  a  bifurcation  occurs  at  this  point,  a 
bifurcation  involving  at  least  one  additional  periodic  orbit. 

This  result  says  that  additional  fixed  points  or  periodic 
points  must  bifurcate  from  Eg  at  /j  =  0.  These  bifurcating  orbits', 
need  not  to  be  stable.  An  example  of  the  preservation  of  orbit 
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index  occurs  with  a  period  doubling  bifurcation.  If  for  <  0 
there  is  an  attracting  fixed  point  (and  no  other  entering  orbits), 
the  total  index  is  +1.  Then  for  ij  >  0  we  can  have  a  flip  saddle 
(orbit  index  0)  and  a  period  2  attractor  (orbit  index  +1).  Hence, 
the  sura  of  the  orbit  indices  before  and  after  /i  =  0  is  +  1.  Note 
that  the  two  points  of  the  period  2  orbit  are  collectively 
assigned  +1,  not  individually,  since  that  orbit  has  index  +1. 

Since  this  bifurcation  occurs  while  the  fixed  point  (or  periodic 
point)  collides  with  the  border  of  the  regions  and  Rg,  we  call 
it  a  border-collision  bifurcation .  In  other  words,  a  border- 
collision  bifurcation  is  a  bifurcation  at  a  fixed  point  (or 
periodic  point)  on  the  border  of  two  regions  when  the  orbit  index 
of  the  fixed  point  (or  periodic  point)  ‘•efore  the  collision  with 
the  border  is  different  from  the  orbit  index  of  the  fixed  point 
after  the  collision. 


We  derive  the  raap  P  that  was  introduced  in  Section  I,  from 

h 

nonlinear  piecewise  smooth  maps.  We  assume  coordinates  are  chosen 
so  that  the  curve  F  is  a  straight  line.  Let  z  denote  any  vector  in 
the  plane,  and  write  =  F(z;y),  and  write  Zq  =  Hq.  From  the 

assumption  F^  is  piecewise  smooth,  we  have  that  on  each  of  the 
regions  R^  and  Rg 

F(z]ii)  =  FIZqJO)  +  D^F{Zg,0){z-ZQ)  +  D^F(Zg,0)jj  +  H.O.T. 

where  H.O.T.  stands  for  Higher  Order  Terms.  Hence,  there  exist 

matrices  M,  and  and  vectors  v,  and  v„  such  that  if  z  is  in  the 
A  B  A  B 

region  R^  then 

F(z;^)  =  F(Zq;0)  +  M^(z-Zg)  +  v^/j  +  H.O.T. 
and  if  z  is  in  the  region  Rg  then 


F(z;/i)  =  F(Zq;0)  +  M^Iz-Zq)  +  +  H.O.T. 

Let  be  the  unit  vector  tangent  to  F  at  Zq.  The  assumption  F^ 
is  piecewise  smooth  and  depends  smoothly  on  ^  implies  M^e^^  = 

=  Co  and  V.  s  v„  s  v.  Choose  coordinates  so  that  Zq  =  0,  so 
F(Zq,0)  =  0,  Assume  that  eg  is  independent  of  e^^,  so  we  may  use  e^ 
and  eg  as  basis  vectors.  We  let  e^  and  eg  be  the  basis  vectors  of 
the  plane.  We  assume  that  eg  is  independent  of  v  and  that  v  is  not 
parallel  with  e^-Cg.  We  claim  that  by  change  of  variables  and  by 
rescaling  n  we  may  assume  that  v  =  ej.  Write  v  =  ^''x’'^y^’ 
assume  that  v^  ^  0.  We  can  make  v^  =  0  after  a  change  of 
variables,  and  v^  =  1  by  rescaling  of  p.  If  v^  is  not  0  then  we 
can  change  variables,  setting  y  *  y  “  (where  x  is  unchanged!, 

and  the  new  vector  v  for  the  (x,y)  system  will  have  its  second 


coordinate  0.  By  rescaling  that  is,  by  introducing  ^  , 

can  change  the  system  so  that  the  new  vector  v  is  (1,0),  when 

Ta  ll 


the  parameter.  Therefore,  we  may  write 


Lb 


a 


we 

u  i  s 

'1 

!  , 

■'J 


and  V  =  (1,0).  Since  all  these  assumptions  are  generic,  we  say  tne 
prototype  piecewise  I  inear  form  of  F  for  /J  small  is  defined  ov 


F{z;m) 

F  (  z ;  fi ) 


0 

1 


z 


0 


+  mU,0) 

+  m( 1 ,0) 


if  z  is  in  the  region  R^, 
if  z  is  in  the  region  Rg. 


To  write  the  prototype  piecewise  linear  form  of  F  in  the  lorm 


a+c  b+d 


a-c  b-d 


of  the  map  P^,  let  u  =  (— »  ^-) ,  and  w  = 


) . 


We  observe  the  following  fact.  Assume  that  the  fixed  point  i 
a  flip  saddle  (orbit  index  0)  in  region  R^  and  a  repeiior  with 
complex  eigenvalues  (orbit  index  +1)  in  region  Rg.  If  there  exiats 
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a  stable  periodic  orbit  with  period  2  in  that  converges  to  Eq 
when  u  approaches  0,  then  the  total  degree  in  is  +1.  Hence,  if 
there  exists  a  stable  periodic  orbit  in  Rg  that  converges  to  Eq 
when  fi  goes  to  0,  then  there  must  exist  a  regular  saddle  periodic 
orbit  of  the  same  period  (orbit  index  -1)  in  Rg  that  converges  to 
Eq  when  (j  goes  to  0,  since  the  total  orbit  index  is  a  bifurcation 
invariant.  Consequently,  for  the  family  of  maps  f  in  the  Section 
1  exhibiting  a  "period  two  to  period  three"  bifurcation  in  figure 
2,  there  must  also  exist  a  regular  saddle  periodic  orbit  with 
period  3. 

PERIOD  TWO  TO  PERIOD  THREE  BORDER-COLLISION  BIFURCATION  THEOREM. 

Let  F  be  a  one-parameter  family  of  i  iecewise  smooth  ma’'s  which 
M 

has  a  prototype  piecewise  linear  form  at  ^  =  0,  and  assume  that 
(1)  a  <  -1,  c  <  -1,  d  <  -1;  (2)  c^  +  4d  <  0;  and  (3)  0  <  a{ac  +  d)  < 
1.  Then,  there  exists  e  >  0  such  that  if  |b|  <  e,  then  the  family 
F  has  a  "period  two  to  period  three"  border-collision  bifurcation 
at  (0,0). 

We  point  out  that  the  border-collision  bifurcations  persist 
under  small  perturbations.  The  proof  follows  of  the  Theorem  from 
the  result  obtained  in  Section  4.  The  geometrical  proof  given  in 
Section  4,  might  give  insight  why  other  bifurcations  (for  example, 
period  5  to  period  2  bifurcation)  may  occur  in  piecewise  smooth 
systems.  Presumably,  the  method  of  proof  only  works  if  one  of  the 
two  maps  involved  has  a  small  Jacobian.  Hence,  when  the  piecewise 
smooth  map  consists  of  maps  that  all  have  Jacobian  bounded  (far) 
away  from  zero,  new  techniques  have  to  be  developed  to  obtain 
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rigorous  border-collision  bifurcation  results. 


3.  A  VARIETY  OF  BORDER-COLLISION  BIFURCATIONS. 

In  this  Section  we  present  a  variety  of  numerical  examples 
exhibiting  a  border-collision  bifurcation.  The  first  series  of 
examples  is  from  the  piecewise  linear  map  P  ,  and  the  second 

r* 

series  is  based  on  the  H6non  map.  We  will  present  examples  showing 
that  in  a  border-collision  bifurcation  not  only  attracting 
periodic  orbits  are  involved,  but  also  chaotic  saddles  may  play  a 
role.  Therefore,  in  order  to  describe  the  qualitatively  different 
border-collision  bifurcations  in  a  consistent  manner,  we  refer  to 
the  invariant  sets  that  are  involved  in  the  border-collision 
bifurcation.  A  chaotic  saddle  is  a  compact,  invariant  set  that  is 
not  an  attractor  which  contains  a  chaotic  trajectory.  If  an 
attractor  A  of  a  map  F  is  an  attracting  periodic  orbit  with  period 
p,  then  we  call  A  a  period  p  attractor .  and  we  say  instead  of 
“period  two  to  period  three"  bifurcation  a  bifurcation  from  a 
period  2  attractor  to  a  period  3  attractor. 

The  bifurcation  diagrams  below  show  the  long  term  behavior  of 
the  coordinate  x  for  ^  between  -0.1  and  0.2.  The  diagrams  have 
been  constructed  as  follows.  For  the  minimum  value  -0.1  of  and 
initial  value  (0,0),  calculate  the  first  200  points  (transient 
time  200)  of  the  orbit  and  plot  the  next  1000  points  of  the  orbit. 
Increase  p  slightly,  say  by  0.001,  take  for  the  initial  value  the 
last  point  which  was  plotted,  calculate  200  points  of  this  orbit 
and  plot  the  next  1000  points.  Increase  ^  again,  and  continue 
increasing  until  (J  achieves  the  maximum  value  0.2.  Hence,  once  the 
orbit  is  close  to  an  attractor,  as  the  parameter  is  increased. 
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this  attractor  is  '’followed"  as  long  as  it  exists.  In  the 
diagrams,  the  x-coordinate  is  plotted  vertically,  and  the 
parameter  ^  is  plotted  horizontally. 


Define  the  map  GL^  from  the  plane  to  itself  to  be  the  prototype 

piecewise  linear  form  of  F  ,  that  is, 

GL  (x,y)  s  {ax  +  y,  bx)  +  ^(1,0)  if  x  s  0 

GL^(x,y)  =  (cx  +  y,  dx)  +  /i(l,0)  if  x  i  0 

Recall  that  the  map  GL  is  equivalent  to  the  map  P  ,  since  to 

write  the  map  GL  in  the  form  of  the  map  P  ,  let  u  = 

and  w  =  We  present  a  few  numerical  examples  for  this 

map  GL  exhibiting  a  border-collision  bifurcation.  In  all  these 
d 

examples,  the  fixed  point  is  a  flip  saddle  for  <  0  and  a 
repellor  with  complex  eigenvalues  for  /i  >  0. 


EXAMPLE  1.  The  presumably  simplest  border-collision  bifurcation 
is  from  a  period  2  attractor  to  a  period  3  attractor  presented  in 
Figure  1.  We  present  parameter  values  for  which  the  map  GL  shows 
a  bifurcation  from  a  period  2  attractor  to  a  period  p  attractor 
for  a  variety  of  period  p. 

For  a  =  -1.25,  b  =  -.035,  c  =  -2,  d  =  -1.75,  the  bifurcation 
diagram  in  Figure  3a  exhibits  a  bifurcation  from  a  period  2 
attractor  to  a  period  5  attractor. 

For  a  =  -1.25,  b  =  -0.0435,  c  =  -2,  d  =  -2.175,  the  bifurcation 
diagram  in  Figure  3b  exhibits  a  bifurcation  from  a  period  2 
attractor  to  a  period  11  attractor. 

For  a  =  -1.25,  b  =  -0.03943,  c  =  -2,  d  =  -1.9715,  the 
bifurcation  diagram  in  Figure  3c  exhibits  a  bifurcation  from  a 
period  2  attractor  to  a  period  52  attractor. 
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Figui'e  3a. 

Bifurcation  diagram  of 

GL^(x,y)  =  (-1.25X  +  y  +  -0.035x)  if  x  i  0,  and 

=  (-2x  +  y  +  /j,  -1.75x}  if  X  i  0 

exhibits  at  Mq  =  0  a  border-collision  bifurcation  from  a  period  2 
attractor  to  a  period  5  attractor.  The  parameter  n  (plotted 
horizontally)  varies  from  -0.1  to  0.2,  and  the  coordinate  x  is 
plotted  vertically,  -0.3  i  x  s  0.3. 


Bifurcation  diagram  of 

GL^(x,y)  =  (-1.25x  +  y  +  fi,  -0.0435x)  if  x  i  0,  and 
=  (-2x  +  y  +  n,  -2.175X)  if  x  i  0 
exhibits  at  =  0  a  border-collision  bifurcation  from  a  period 
attractor  to  a  period  11  attractor.  The  parameter  ^  (plotted 
horizontally)  varies  from  -0.1  to  0.2,  and  the  coordinate  x  is 
plotted  vertically,  -0.3  £  x  s  0.3. 


Bifurcation  diagram  of 

“VU.y)  =  ,.,,25^  ^  ^ 

-  (  o  ^•03943x)  if  X  n 

-  (-2x  +  y  +  X  i  0,  and 

at  ''0  =  BuJ:der:ln 

attractor  to  a  period  52  attra  “‘’'"''Nation  from 

^-laontaliy,  .arias  from  -oTt  ^  ''  '^■ 

P  Ptted  vertically,  -0,3  s  _  ■^’  ‘ha  coordim 

^  V  •  O  , 


For  other  choices  for  a,  b,  c,  and  d  we  have  found  bifurcations 
from  a  period  2  attractor  to  a  period  p  attractor,  where  p  =  6,  7, 
8,  9,  10,  11,  13,  19,  21,  23,  29,  31,  37,  41,  etc. 

EXAMPLE  2.  The  simplest  border-collision  bifurcation  in  which 
chaotic  attractors  are  involved  is  presumably  the  bifurcation  from 
a  period  2  attractor  to  a  (1-piece)  chaotic  attractor.  Frequently, 
the  border-collision  bifurcation  from  a  period  2  attractor  to  a 
p-piece  chaotic  attractor  is  observed. 

For  a  =  -1.25,  b  =  -0.042,  c  =  -2,  and  d  =  -2.1,  the 
bifurcation  diagram  in  Figure  4a  exhibits  a  bifurcation  t rom  a 
period  2  attractor  to  a  1-piece  chaotic  attractor. 

For  a  =  -1.36,  b  =  -0.12,  c  s  -2,  and  d  =  -2,  the  Kifurcation 
diagram  in  Figure  4b  seems  to  exhibit  a  bifurcation  from  a  period 
2  attractor  to  a  12-piece  chaotic  attractor,  but  using  the  phase 
space  it  turns  out  that  the  bifurcation  is  from  a  period  2 
attractor  to  a  18-piece  chaotic  attractor. 

We  have  observed  many  other  values  of  p,  the  map  GL^  shows  a 
bifurcation  from  period  2  attractor  to  p-piece  chaotic  attractor. 

For  the  selection  a  =  -1.25,  b  =  -0.03865,  c  =  -2,  and  d  = 
-1.9325,  we  obtain  a  bifurcation  diagram  similar  to  figure  4a,  but 
in  this  case  the  border-collision  bifurcation  is  from  a  period  2 
attractor  to  a  what  appears  to  be  quasi-periodic  attractor. 

EXAMPLE  3.  A  border-collision  bifurcation  in  which  chaotic 
saddles  (rather  than  attractors)  are  involved,  v/ill  not  be 
exhibited  by  bifurcation  diagrams.  Therefore,  some  other  numerical 
method  is  needed  to  detect  these  sets.  We  use  the  Saddle  Straddle 


Figure  4a. 

Bifurcation  diagram  of 

GL^(x,y)  =  (-1.25X  +  y  +  /j,  -0.042x)  if  x  i  0,  and 
=  ( -2x  +  y  +  ju,  -2.  lx)  if  X  a  0 

exhibits  at  =  0  a  border-collision  bifurcation  from  a  period  2 
attractor  to  a  1-piece  chaotic  attractor.  The  parameter  ^  (plotted 
horizontally)  varies  from  -0.1  to  0.2;  the  coordinate  x  is  plotted 
vertically,  -0.3  ^  x  2  0.3. 


Figure  4b, 

Bifurcation  diagram  of 

GL^^(x,y)  =  {-1.36x  +  y  +  -0.12x)  if  x  s.  0,  and 

=  (-2x  +  y  +  /j,  -2x)  if  X  i  0 

exhibits  at  jJq  =  0  a  border-collision  bifurcation  from  a  period 
attractor  to  a  18-piece  chaotic  attractor.  The  parameter  u 
(plotted  horizontally)  varies  from  -O.l  to  0.2;  the  coordinate 
is  plotted  vertically,  -0.3  s  x  ^  0.3. 


Trajectory  ( SST )  method  introduced  in  [NY]  to  detect  such  sets. 

We  select  a  =  -1.25,  b  =  0.18,  c  =  2,  and  d  =  -3.  For  jj  =  -0.05 
the  invariant  set  (obtained  by  the  SST  method)  is  presented  in 
Figure  5a,  and  the  invariant  set  for  ^  =  0.05  is  in  Figure  3b. 
Presumably,  it  is  correct  to  say  that  the  border-collision 
bifurcation  is  a  bifurcation  from  a  chaotic  saddle  to  another 
chaotic  saddle. 


Now  we  present  a  few  examples  based  on  the  Henon  map.  In  fact, 
in  these  examples  we  have  a  moving  border.  Define  the  map  H  from 
the  plane  to  itself  by 

H(x,y)  =  (A  -  x^  +  By,  x) 

and  define  the  map  ( -»  <  fj  <  <s>)  from  the  plane  to  itself  by 
L  (x,y)  =  (A  +  Cx  +  By  -  (m+C);j,  Dx  +  (l-D)ju) 

r* 

The  regions  and  Rg  are  the  half  planes  to  the  left  and  the 

right  of  the  straight  line  x  -  (j.  The  map  we  are  investigating  i 

defined  being  the  Henon  map  on  R.  and  the  "linear"  map  L  on  n,  . 

.A  M  ' 

Define  the  one-parameter  family  of  maps  F^  from  the  plane  to 
itself  by 


rH(x,y)  ifxs^ 


F^(x,y)  = 


[  b^(x,y)  if  X  i  M 

Notice  that  the  map  is  smooth  in  each  of  the  half  planes  x  ^  M  and 
X  i  /j,  and  the  line  x  =  /j  is  the  border  which  is  a  smooth  curvp. 
Since  the  map  F^  is  continuous,  it  is  a  piecewise  smooth  map.  \o*-' 
that  for  this  family  F  border-collision  bifurcations  occur 
presumably  for  values  different  from  zero. 
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Figure  5a. 

Chaotic  saddle  of 

GL  (x,y)  =  (-1.25X  *  J  +  0.18x)  if  x  i  0,  and 

fj 

=  (2x  +  y  +  -3x)  if  X  i  0  when  ^  =  -0.05. 

The  coordinate  x{-0.25x^0.1)  is  plotted  horizontally,  and  the 
coordinate  y  (  -0.25  ^  y  i  0.02)  is  plotted  vertically. 


Figure  5b. 

Chaotic  saddle  of 

GL  (x.y)  =  (-1.25X  +  y  +  M.  0.18x)  if  x  ^  0,  and 
^  =  (2x  +  y  +  Ai.  -3x)  if  X  a  0  when  ^  =  0.05. 

The  coordinate  x  (-1  a  x  a  0.6)  is  plotted  horisontally.  and  the 
coordinate  y  (  -i.8  a  y  s  0.2)  is  plotted  vertically. 


EXAMPLE  4.  Simple  border-collision  bifurcations  are 
bifurcations  from  a  period  p  attractor  to  a  period  q  attractor. 

For  A  =  1.4,  B  =  0.3,  C  =  0.9,  and  D  =  -5,  the  bifurcation 
diagram  in  Figure  6a  exhibits  a  bifurcation  from  a  period  3 
attractor  to  a  period  4  attractor,  where  fi  (plotted  horizontally) 
varies  from  0.89  to  0.87.  In  the  region  the  fixed  point  is  a 
flip  saddle  and  in  the  region  Rg  the  fixed  point  is  a  repellor. 

The  border-collision  bifurcation  occurs  at  ^  =  /Jq  «  0.884.  For  iJ  > 
Hq  (the  side  of  the  period  3  attractor  which  has  orbit  index  +1) 
the  fixed  point  is  a  flip  saddle  (orbit  index  0)  and  we  find  no 
other  periodic  orbits  on  this  side  of  the  bifurcation.  For  n  '  /Jq 
(the  side  of  the  period  4  attractor  which  has  orbit  index  +1)  the 
fixed  point  is  a  repellor  (orbit  index  +1);  there  also  exists  a 
period  4  regular  saddle  (orbit  index  -1).  The  regular  saddle  also 
shrinks  to  a  point  (the  fixed  point)  as  -»  Mq*  Hence,  the  orbit 
index  is  +l  on  both  sides  of  /Jq. 

For  A  =  1.4,  B  =  0.3,  C  =  I,  and  D  =  -5,  the  bifurcation 
diagram  in  Figure  6b  exhibits  a  bifurcation  from  a  period  6 
attractor  to  a  period  4  attractor,  where  ^  (plotted  horizontally) 
varies  from  1.05  to  0.8.  In  the  figure  one  might  first  notice  a 
bifurcation  from  a  6-piece  chaotic  attractor  to  a  period  4 
attractor,  but  closer  examination  gives  the  above  mentioned 
bifurcation  from  a  period  6  attractor  to  a  period  4  attractor. 
Similarly  as  above,  the  periodic  orbits  involved  in  the 
border-collision  bifurcation  that  occurs  at  p  =  /Jq  «  0.884  are  the 
following.  For  /j  >  Uq  there  is  period  6  attractor  and  the  fixed 
point  is  a  flip  saddle,  and  for  ^  the  fixed  point  is  a 

repellor  and  there  is  a  period  4  attractor  a  period  4  regular 
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Figure  6a. 

Bifurcation  diagram  of 

F{x,y)  =  (1.4  -  +  0.3y,  x)  if  x  Sji,  and 

=  (1.4  +  0.9x  +  0.3y  -  {jj+0.9)p,  -5x  +  6/j)  if  x  i  /J, 
exhibits  at  Pq  «  0.884  a  border-collision  bifurcation  from  a 
period  3  attractor  to  a  period  4  attractor.  The  parameter  y 
(plotted  horizontally)  varies  from  0.89  to  0.87;  the  coordinate 
is  plotted  vertically)  0.6  £  x  5  1.2. 


Figure  6b. 

Bifurcation  diagram  of 
F  (x,y)  =  (1.4  -  +  0.3y,  x)  if  x  i  fi,  and 

^  =  (1.4  +  X  +  0.3y  -  (*i+l)df  -5x  +  6^)  if  x  i 

exhibits  at  /Jq  **  0-884  a  border-collision  bifurcation  from  a 
period  6  attractor  to  a  period  4  attractor.  The  parameter  ^ 
(plotted  horizontally)  varies  from  1.05  to  0.8;  the  coordinate  k 

is  plotted  vertically,  -0.5  5x^2. 


saddle.  Hence,  the  orbit  index  is  +1  on  both  sides  of 

EXAMPLE  5.  In  this  example  we  present  two  cases  of  a 
border-collision  bifurcation  from  a  period  p  attractor  to  a  q-piece 
chaotic  attractor. 

For  A  =  1.4,  B  =  0.3,  C  =  1,1,  and  D  =  -5,  the  bifurcation 
diagram  in  Figure  7a  exhibits  a  bifurcation  from  a  1-piece  chaotic 
attractor  to  a  period  4  attractor,  where  fi  (plotted  horizontally) 
varies  from  1.05  to  0.8.  The  border-collision  bifurcation  occurs  at 
U  =  0.885.  For  fj  >  (the  side  with  the  chaotic  attractor) 

we  do  not  know  the  (total)  orbit  index  since  the  chaotic  attractor 
contains  a  lot  of  periodic  orbits.  For  the  fixed  point  is  a 

flip  saddle  (orbit  index  0).  For  n  <  (the  side  of  the  period  4 
attractor  which  has  orbit  index  +1)  the  fixed  point  is  a  repelior 
(orbit  index  +1)  there  also  exists  a  period  4  regular  saddle 
(orbit  index  -1).  The  regular  saddle  also  shrinks  to  the  t' i  .od 
point  as  p  -♦  .  Hence,  presumably  we  have  a  border-collision 

bifurcation  from  a  period  4  attractor  to  a  1-piece  chaotic 
attractor . 

For  A  =  1.4,  B  =  0.3,  C  =  1.5,  and  D  =  -4,  the  bifurcation 
diagram  in  Figure  7b  exhibits  a  bifurcation  from  a  S-piece  chaotic 
attractor  to  a  period  5  attractor,  where  ^  (plotted  horizontally) 
varies  from  0.91  to  0.86.  The  border-collision  bifurcation  occurs 
at  /j  =  «  0.884.  For  ^  >  (the  side  of  the  8-piece  chaotic 

attractor)  we  do  not  know  the  (total)  orbit  index  since  the 
chaotic  attractor  contains  a  lot  of  periodic  orbits,  and  the  fixed 
point  is  a  flip  saddle  (orbit  index  0).  For  n  <  (the  side  of 
the  period  5  attractor  which  has  orbit  index  +1)  the  fixed  point 
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Figure  7a. 

Bifurcation  diagram  of 
F^lx.y)  =  (1.4  -  +  0.3y,  x)  if  x  i/i,  and 

=  (1.4  +  l.lx  +  0.3y  -  (/i+l.l);i,  -5x  +  6fj}  if  x  i  H, 
exhibits  at  /Jq  «<  0.885  a  border-collision  bifurcation  from  a 
1-piece  chaotic  attractor  to  a  period  4  attractor.  The  parameter  /j 
(plotted  horizontally)  varies  from  1.05  to  0.8;  the  coordinate  x 
is  plotted  vertically,  -0.5  £  x  ^  2. 


•  xvV'i 


-TAy 


^  i~~  -* ' 


•^^-VVJrVr;  ^cr 

•I'Vr, >  .«•  ^Vi 


t-7i^- 


r*^;| 


Figure  8. 

Bifurcation  diagram  of 
F  (x.y)  =  (1.4  -  x^  +  0.3y,  x)  if  x  i  M:  and 
^  =  (1.4  +  1.2x  +  0.3y  -  (m+1-2)/J.  "^x  +  5/j)  if  x  i  M, 

exhibits  at  Mq  «  0.884  a  border-collision  bifurcation  from  a 
1-piece  chaotic  attractor  to  a  1-piece  chaotic  attractor.  The 
parameter  p  (plotted  horizontally)  varies  from  0.95  to  0.85;  the 
coordinate  x  is  plotted  vertically,  0.4  s  x  ^  1.6. 


is  a  repellor  (orbit  index  +1);  there  also  exists  a  period  5 
regular  saddle  (orbit  index  -1).  The  regular  saddle  also  shrinks 
to  the  fixed  point  as  u  In  the  figure  one  might  first  notice 

a  bifurcation  from  a  5-piece  chaotic  attractor  to  a  period  5 
attractor,  but  closer  examination  in  the  phase  space  gives  the 
above  mentioned  bifurcation  from  a  8-piece  chaotic  attractor  to  a 
period  5  attractor.  Hence,  presumably  we  have  a  border-collision 
bifurcation  from  a  period  5  attractor  to  a  8-piece  chaotic 
attractor . 

EXAMPLE  6.  Border-collision  bifurcation  from  a  p-piece  chaoli 
attractor  to  a  q-piece  chaotic  attractor.  We  present  just  one 
example,  namely  p  =  a  =  1. 

For  A  =  1.4,  B  =  0.3,  C  =  1.2,  and  D  =  -4,  the  bifurcation 
diagram  in  Figure  8  exhibits  a  bifurcation  from  a  1-piece  chaoric 
attractor  to  a  1-piece  chaotic  attractor,  where  p  (plotted 
horizontally)  varies  from  0.95  to  0.85.  The  border-collision 
bifurcation  occurs  at  p  =  «  0.884  and  we  onJy  can  say  that  n 

both  sides  infinitely  many  periodic  orbits  are  involved  in  the 
border-collision  bifurcation,  since  the  attractors  are  chaotic. 
Hence,  presumably  we  have  a  border-collision  bifurcation  from  a 
1-piece  chaotic  attractor  to  a  1-piece  chaotic  attractor. 

EXAMPLE  7.  In  this  example  we  show  that  coexisting  attractors 
of  different  nature  can  be  involved  on  the  same  side  of  a 
border-collision  bifurcation. 

For  A  =  1.4,  B  =  0.3,  C  =  1.4,  and  D  =  -4,  the  bifurcation 
diagram  in  Figure  9a  exhibits  a  bifurcation  from  a  5-piece  chaot  i. 
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Figure  9a. 

Bifurcation  diagram  of 

=  (1.4  -  +  0.3y,  x)  if  x  a  and 

=  (1.4  +  1.4x  +  0.3y  -  (|j+1.4)/j,  -4x  +  5^)  if  x  i  ji, 
exhibits  at  /Jq  «  0.884  a  border-collision  bifurcation  from  a 
5-piece  chaotic  attractor  to  a  1-piece  chaotic  attractor.  The 
parameter  n  (plotted  horizontally)  varies  from  0.87  to  0.895;  the 
coordinate  x  is  plotted  vertically,  0.3  ^  x  ^  1.6. 


Figure  9b. 

Bifurcation  diagram  of 
F^{x,y)  =  (1.4  -  +  0.3y,  x)  if  x  and 

=  (1.4  +  1.4x  +  0.3y  -  {/j+1.4)/j,  -4x  +  5^)  if  x  i  /i, 
exhibits  at  Hq  v  0.884  a  border-collision  bifurcation  from  a 
5-piece  chaotic  attractor  to  a  period  4  attractor.  The  parameter  p 
(plotted  horizontally)  varies  from  0.874  to  0.895;  the  coordinate 
X  is  plotted  vertically,  0.3  5x5  1.6. 


attr-actor  to  a  1-piece  chaotic  attractor,  where  ^  (plotted 
horizontally)  varies  from  0.87  to  0.895.  On  both  sides  of  the 
collision-bifurcation-,  which  occurs  at  /Jq  w  0.884,  there  are 
infinitely  many  unstable  periodic  orbits  involved,  since  the 
attractors  are  chaotic.  Due  to  the  projection  of  the  picture  onto 
one  phase  space  coordinate  the  bifurcation  diagram  seems  to  show  a 
2-piece  chaotic  attractor,  but  again  in  phase  space  one  has 
clearly  a  5-piece  chaotic  attractor. 

For  the  same  parameter  values,  the  bifurcation  diagram  in 
Figure  9b  exhibits  a  bifurcation  from  a  5-piece  chaotic  attractor 
to  a  period  4  attractor,  where  fj  (plotted  horizontally)  varies 
from  0.874  to  0.895.  Hence,  we  may  have  a  border-collision 
bifurcation  from  a  5-piece  chaotic  attractor  to  a  coexisting 
1-piece  chaotic  attractor  and  a  period  4  attractor. 


EXAMPLE  8.  Now  we  consider  an  example  in  which  t)»e  rurvp  is 

the  straight  line  y  =  -x  +  /j.  In  this  example  we  have  a  moving 

border.  Let  the  map  H  from  the  plane  to  itself  be  defined  as 

2 

above,  that  is,  H(x,y)  =  (A  -  x  +  By,  x),  and  define  the  map 

(-D  <  ^  <  oo)  from  the  plane  to  itself  by 

G  (x,y)  =  (A  -  pC  -  x^  +  Cx  +  (B+C)y,  (B+D)x  -  Dy  -pD ) 

The  regions  R.  and  R„  are  the  half  planes  to  the  left  and  the 
A  o 

right  of  the  curve  F^.  The  map  we  are  investigating  is  defined 
being  the  Henon  map  on  R^  and  the  "linear"  map  G^  on  Rg.  Define 
the  one-parameter  family  of  maps  F  from  the  plane  to  itself  by 

rH(x,y)  ifxs-y  +  /j 


F^(x,y) 


I 


if  X  i  -y  +  11 
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Figure  10a. 

Bifurcation  diagram  of 

F  (x,y)  =  (1.4  -  +  0.3y,  x)  if  x  i  -y  +  /j,  ana 

=  (1.4  +  0.5fj  -  x^  +  0.5x  +  0.2y,  -1.3x  +  y  +  .u)  if 
X  i  -y  +  ^>  exhibits  at  /Jq  «  1.015  a  border-collision  bifurcation 
from  a  period  4  attractor  to  a  strange  chaotic  attractor.  The 
parameter  jj  (plotted  horizontally)  varies  from  1.2  to  1;  the 
coordinate  x  is  plotted  vertically,  -2  £  x  s  2. 


Figure  10b. 

The  chaotic  strange  attractor 

=  -  if  ana 

^  ^  -y  *  whJe  n''  I  ^  if 

,  ,  /J  1.  The  coordinate  x  (-2  ^  v  < 

horizontally,  anri  .i  ■  ^  ^  ^  ^  <i )  is  plotted 

yi  and  the  coordinate  y  {  -2  <  v  <  o \  ■  , 

vertically  ^  y  5  2)  is  plotted 


Notice  that  the  map  is  a  piecewise  smooth  map.  We  present  an 
example  for  which  the  map  has  a  the  border-collision 
bifurcation  from  a  period  4  attractor  to  a  chaotic  strange 
attractor.  For  A  =  1.4,  B  =  -0.3,  C  =  0.5,  and  D  =  -1,  the 
bifurcation  diagram  in  Figure  10a  exhibits  a  bifurcation  from  a 
period  4  attractor  to  a  chaotic  strange  attractor,  where  /j 
(plotted  horizontally)  varies  from  1.2  to  1.  The  border-collision 
bifurcation  occurs  at  p  =  /Jq  «  1.015.  The  chaotic  strange 
attractor  for  /j  =  1  is  given  in  Figure  10b.  Hence,  we  may  have  a 
border-collision  bifurcation  from  a  period  4  attractor  to  a 
chaotic  strange  attractor. 


4.  "PERIOD  TWO  TO  PERIOD  THREE"  BORDER-COLLISION  BIFURCATION 
In  this  Section  we  explain  why  "period  two  to  period  three" 
border-collision  bifurcations  occur  for  two-dimensional  piecewise 
smooth  maps.  Let  a,  b,  c,  and  d  denote  real  numbers.  Define  the 
one-parameter  family  GL  from  the  plane  to  itself,  by 

GL^(x,y)  =  (  ax  +  y ,  bx  )  +  /i{  1 , 0  )  if  x  <  U 

GL^(x,y)  =  (cx  +  y,  dx)'t-^{l,0)  ifxaO 

where  ^  is  in  an  open  interval  I  including  zero.  Recall  that  this 
family  GL  is  equivalent  with  the  piecewise  linear  map  P_  . 

fj  ^ 

Let  F^  be  a  one-parameter  family  of  piecewise  smooth  maps  which 
has  a  prototype  piecewise  linear  form  at  /j  =  0,  and  assume  that 
( A1 )  -a  >  1 ,  -c  >  I ,  -d  >  1 ; 

(A2)  c^  +  4d  <  0; 

( A3 )  0  <  a( ac  +  d)  <  1 . 

We  want  to  show  that  there  exists  e  >  0  such  that  if  |b|  <  e,  then 


the  family  F  has  a  "period  two  to  period  three"  border-collision 
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bifurcation  at  (0,0).  First,  we  show  that  for  b  =  0,  the  family 
GL  has  a  border-collision  bifurcation  from  a  period  2  attractor 
to  a  period  3  attractor.  We  write  C  for  the  set  of  all 
one-parameter  families  of  maps  GL  defined  above  such  that  b  =  0. 

PROPOSITION.  At  ^  -  0,  every  family  GL^  in  C  has  a  "period  two 
to  period  three"  border-collision  bifurcation  at  (0,0). 

PROOF  OF  THE  THEOREM.  Assume  that  the  Proposition  has  been  proved. 
Apply  the  Proposition  and  it  follows  immediately  from  perturbation 
results . 

The  geometrical  proof  of  the  Proposi.ion  (given  below)  "ight 

give  insight  why  other  bifurcations  (for  example,  period  5  to 

period  2  bifurcation)  may  occur  in  piecewise  smooth  systems. 

Presumably,  the  method  of  proof  only  works  if  one  of  the  two  maps 

involved  has  a  zero  Jacobian.  We  first  show  that  a 

border-collision  bifurcation  occurs  at  p  =  0,  and  we  present  an 

example  to  give  an  idea  of  the  proof. 

Let  GL  be  in  C.  The  fixed  point  E  of  F  is  given  by  E  = 

(y—'P,  0)  if  p  s  0  and  E^  =  (y—— j-p.  ^I'l.^-p)  if  p  >  0. 

In  the  notation  of  Section  2,  define  the  matrices  and  Mg  by 
*a  i"  ’c  r 

M.  =  ,  M„  =  .  The  eigenvalues  of  M.  are  0  and  a,  so 

[b  oj  ®  [d  oj 

if  p  <  0  then  the  fixed  point  E  is  unstable  since  -a  >  1.  In 

P 

particular,  E  is  a  flip  saddle  if  p  <  0.  The  eigenvalues  of  M- 
P 

/  2  '  2 
are  0.5c  ±  0.5  /  c  +  4d  and  are  complex,  since  c  +  4d  <  0.  For 

p  >  0  the  fixed  point  E  is  unstable  (repelling),  since  the 

P 
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product  -d  of  the  eigenvalues  of  Mq  exceeds  1.  The  nature  of  the 

D 

fixed  point  E  is  changing  from  being  a  flip  saddle  (in  region  R. 

(J  A 

which  is  the  left  half  plane)  to  a  ropellor  with  complex 
eigenvalues  (in  region  Rg)  when  the  parameter  p  is  varied  from  say 
-0.1  to  0.1.  We  conclude  that  a  border-collision  bifurcation 
occurs  at  n  -  0  when  fu  is  continuously  varied  from  some  negative 
value  to  a  positive  value,  since  the  orbit  index  of  E  changes 
from  0  to  +1.  For  simplicity  of  the  explanation  of  this  border- 
collision  bifurcation  phenomenon,  we  offer  the  following  example. 


EXAMPLE.  Consider  the  one-parameter  family  g^  from  the  plane  to 
itself,  defined  by 


g^(x,y)  =  (-;f*x  +  y,  0)  +  jc(l,0) 


if  X  5  0 
if  X  i  0 

The  bifurcation  diagram  exhibiting  the  "period  two  to  period 
three"  bifurcation,  is  similar  to  the  diagram  in  figure  1.  The 


g^lx.y)  =  {-2x  +  y,  --^x )  +  /j*(1,0) 


family  of  maps  g  is  in  the  class  C,  so  it  is  an  exampl-.'  for  which 
the  result  above  applies.  The  idea  why  a  "period  two  tc  period 


three"  border-collision  bifurcation  occurs  for  the  family  g^,  is 
the  following. 

For  p  <  0 ,  write  W  for  the  interval  [-— •p,cD)  =  (-■ i-p,oo)  on  the 

/J  ^  D 

X-axis.  We  have  (1)  the  image  g  (p)  of  each  point  p  on  the  X-axis 

but  not  in  is  in  W^,  ard  (2)  each  point  p  in  W^  is  mapped  lo  a 

2 

point  p*  on  the  X-axis  after  two  iterates,  so  g  (p)  =  p^ .  In 

figure  11,  the  graph  of  the  corresponding  return  map  G  on  whicn 

2 

is  defined  by  G(x)  =  g^  (x,0),  is  given.  To  be  more  specific, 

G(x)  =  -^’X  -  i-p  for  i-jj  i  X  s  0  and  G(x)  =  “■^•x  -  for  x  a  0. 
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is  defined  bV  625x)  ^ 

\s,y)  =  "  T-  g  ^^■'"’ 

r.p  0  defined  by  G U , 

the  X;n:iis  mtn  poi. 


FIGURE  11 


4  2 

The  map  G  has  two  fixed  points  p^  =  <  0  and  p^  =  —g’/J  >  • 

25 

The  fixed  point  p^  is  unstable  since  the  slope  of  G  in  p^  is  y@' 
and  the  fixed  point  p^  is  stable  since  the  slope  of  G  at  p^  is 

A  A  25 

The  properties  (1)  ^  P^  =  0,  (2)  G  has  slope  yg-  at  x  for 

y*p<x<0,  (3)G  has  slope  — for  x  >  0,  and  (4)  G(0)  = 

0,  imply  that  g  has  a  period  2  attractor  consisting  of  the  two 

2  13  7  . 

points  0)  and  ~  that 

the  norms  of  both  these  points  converge  to  zero  as  /j  goes  to  zero, 

that  is,  both  IIP^II  -♦  0  and  IIP2II  -♦  0  as  /j  -♦  0 .  In  other  words,  the 

period  2  attractor  shrinks  to  a  point  as  ^  goes  to  zero;  this 

point  to  which  the  period  2  attractor  converges  is  the  fixed  point 


of  g  at  p  =  0 


For  p  >  0,  each  point  p  on  the  X-axis  is  mapped 


to  a  point  p*  on  the  X-axis  after  three  iterates,  so  g^  (p)  =  p* 

The  graph  of  the  corresponding  return  map  H,  defined  by  H(x)  = 

T  5 

g  (x,0),  is  given  in  figure  12.  In  particular,  H(x)  =  " 

1  1  'I  i  1  5 

for  X  <  0,  H(x)  =  ~  8"^  0  i  x  s  -ryp,  and  H(x)  =  jg-  .  ‘ 

21  „  1 
16’^  for  X  a 

FIGURE  12 


The  map  H  has  an  unstable  fixed  point  p^  =  -^‘l^  >  0  sitid  two  stable 

4  14  -I 

fixed  points  =  ”'3”^  ^  Ps  ~  ^ 

X  with  X  <  p  we  have  lim  H^{x)  =  q  ,  and  for  all  x  with  x  >  p  -e 
^u  n-*®  s  “ 

have  lim  H^(x)  =  p  .  The  properties  (1)  H  has  slope  between  ')  and 

n-«o  '^s 

1  for  X  <  0,  (2)  H  has  slope  bigger  than  1  for  0  <  x  <  (  •>  d 

has  slope  between  0  and  1  for  x  >  -^-p.  and  (4)  H{0)  =  -  ^-p  ^  0 
1  89  1 

and  H(yp)  =  imply  has  a  period  3  attractor 

4  14 

consisting  of  the  points  Sj^  =  (  —g‘U>  0)»  ^2  ~  ^3  " 
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{ — g*M»  that  the  norms  of  ail  three  points  converge 

to  zero  as  ii  goes  to  zero,  that  is,  all  three  ilS^ll  -»  0,  IIS2II  -»  0, 

and  IIS^II  ^  0  as  /j  -»  0.  In  other  words,  the  period  3  attractor 

shrinks  to  a  point  as  n  goes  to  zero;  this  point  to  which  the 

period  3  attractor  converges  is  the  fixed  point  of  g^  at  /j  =  0. 

4 

The  point  0 )  is  a  point  of  a  period  3  orbit  which  is  a 

regular  saddle  of  the  map  g^. 

Conclusion:  at  p  =  0 ,  there  is  a  "period  two  to  period  three" 
border-collision  bifurcation.  END  OF  THE  EXAMPLE. 


PROOF  OF  THE  PROPOSITION.  Let  GL  be  a  one-parameter  family  in 

the  class  C.  where  n  is  in  some  interval  I.  We  write  Pq  =  (>^Q'yQ) 

for  an  initial  condition  and  p  =  (x  ,y  )  for  its  n-th  iterate, 

n  n  n 

that  is,  p  =  GL  0.  each  u.  For  the  particular  initial 

value  (0,0),  we  write  =  (0,0),  Aj^  =  GL^(Aq),  A2  =  GL^(Aj),  A^  = 

GL  (A.,),  and  A,  =  GL  (A.,). 

;j  2  4  3 

For  each  initial  value  p^  =  ( >  Xq  '  observe  the  following 
fact.  If  Xq  i  0  then  y^^  =  0,  and  if  Xq  >  0  then  y^^  =  dxQ  <  0. 
Hence,  it  is  sufficient  to  consider  initial  values  in  the  lower 
half  plane.  Hence,  from  now  on,  we  assume  that  y^  i  0. 

Assume  first,  /j  <  0 .  Recall  that  the  fixed  point 
0)  is  unstable,  and  is  a  flip  saddle,  since  -a  >  1.  Assume  that 
=  (JCg.yg)  is  any  initial  value  with  y^  ^  0.  Then,  if  x^  5  0  then 
y^  =  0,  and  if  Xq  >  0,  then  x^  =  c.Xq  +  y^  +  ;j  <  0  and  so  y2  =  0. 
Therefore,  it  is  sufficient  to  consider  points  on  the  X-axis,  and 
we  will  do  so. 

Consider  the  initial  value  Pq  =  (0,0)  =  Aq.  Computation  of  the 
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((a+l);j,  0), 


first  four  iterates  of  Aq  yields  =  {^,0),  A2  = 

A^  =  ((c(a+l)  +  Dii,  d(a+i)ti),  and  =  ((a+l)(ac  +  d  +  1  )/j,  0). 

The  assumptions  0  <  a(ac  +  d)  <  1  and  -a  >  1  imply  -1  ac  +  d  <  0 

yielding  0  <  <  Xg.  From  -l<ac+d<0,  and  the  assumptions, 

-a  >  1 ,  and  -c  >  1  follows  that  c(a  +  1)  >  0  and  d  <  c;  therefore 

IX3I  >  1 73 1  •  Hence,  Aj^  is  on  the  X-axis  to  the  left  of  Aq  ,  is 

under  and  to  the  left  of  A,,  and  both  A„  and  A,  are  on  the  X-axis 

1  ^4 

to  the  right  of  Aq  and  A^  is  between  Aq  and  Ag. 

First  we  consider  the  image  of  the  X-axis.  Let  Pq  =  ( Xq , yQ )  be 
any  point  on  the  X-axis.  The  image  of  the  right  half  of  the  X-axis 


with  end  point  Aq  is  the  half  line  through  A^  with  end  point  A^^  = 
GL^(Aq),  since  Pj^  =  (cXq  +  dxQ )  for  Xq  >  0.  The  image  of  the 

left  half  of  the  X-axis  with  end  point  Aq  is  the  half  line  on  the 
X-axis  to  the  right  of  A^  with  end  point  A^,  since  p^^  =  (  ^Xq  +  fj, 


0 )  for  x„  ^  0 . 

2 

Define  Q  =  (---^.0)  =  (x^.O)  and  R  =  (  (i-a)?ac  VdT''^*  = 

(XqiO),  The  point  Q  is  mapped  to  A~  iterating  GL  once,  that  is, 

K  U  fJ 

GL  (Q)  =  A„ ,  and  Q  is  on  the  X-axis  between  A,  and  E  since  A,  = 

fj  0  1  iJ  i 

(^,0),  E  =  0)  and  -a  >  1.  The  point  R  is  on  the  X-axis 

to  the  right  of  Aq,  and  R  is  mapped  to  E  iterating  GL  twice, 

9 

that  is,  GL  (R)  =  E  . 

Let  Pq  =  ( Xq , 0 )  be  any  point.  Straightforward  computation  gives 
the  following.  If  Xq  >  0  (that  is,  Pq  is  on  the  X-axis  to  the 
right  of  Aq  )  then  p^  =  (  cXq  +  /j,  cIXq  )  and  P2  =  ([ac  +  cIJxq  + 

(l  +  a)fj,  0),  so  p,,  is  on  the  X-axis.  If  x^  =  0  (that  is,  Pq  =  A,,) 


then  p^  =  (jj,  0)  and  P2  =  ((1+a)^,  0),  so  p,,  is  on  the  X-axis  to 
the  right  of  Aq  .  If  ^  ^  (that  is,  Pq  is  on  the  X-axis 

between  Q  and  A^ )  then  p,  =  ( ax^  +  fi,  0)  and  p„  =  (a(axQ  +  ^)  +  ju, 
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0),  so  p-  is  on  the  X-axis.  If  <  - M  (that  is,  is  to  the 

0  a  u 

left  of  Q)  then  Pj^  =  ( axQ  +  fj,  0)  and  P2  =  (c(axQ  +  n)  +  n,  diax^ 

2 

+  /i))  and  p^  =  (  [a  c  +  adjx^  +  '  ad  +  a  +  d  +  1 ) -p,  0),  and  so  p^ 

is  on  the  X-axis  while  P2  is  not.  Summarizing,  for  each  point  p^ 

2 

on  the  X-axis  to  the  right  of  Q  we  have  P2  =  GL^ 

X-axis.  Therefore,  we  have  a  return  map  on  the  interval  consisting 
of  the  points  on  the  X-axis  to  the  right  of  Q. 

2 

Let  G  denote  the  return  map  of  GL  on  [Q,cd),  so  G(x)  =  GL  (x,0) 

M  • 

2 

for  each  x  i.  x^.  The  above  results  imply  G(x)  =  a  x  +  (l+a)/j  for 
W 

-i-fj  s  X  ^  0,  and  G(x)  =  (ac+d)x  +  (l  +  a)ji  for  x  2:  0 .  The  graph  of 

2l 

G-  is  similar  to  figure  11.  The  map  G  has  two  fixed  points,  namely 


a  +  1 


p  =  - u,  and  p  =  - T- 

u  1-a  s  1  -  ac  -  d 


■p,  and  p  <  0  <  p  .  The  fixed 


point  p^  is  unstable  since  the  slope  of  G  in  p^  is  a  >1,  and  the 

fixed  point  p  is  stable  since  the  slope  of  G  at  p  is  ac  +  d  for 
s  s 

which  -1  <  ac  +  d  <  0.  Furthermore,  for  all  x  with  p^  <  x  <  we 

have  lim  G*^(x)  =  p  .  The  properties  (1)  x-  <  <0,  (2)  G  has 

n-KD  ^  s  ^  Q  1-a 

2 

slope  a>l  ifx^<x<0,  (3)G  has  slope  -1  <  ac  +  d  ^  0  tor  x 

>  0,  and  (4)  G(0)  >  0,  imply  that  GL^  has  a  period  2  attractor 

a  +  1 

consisting  of  the  points  '"~'H  ‘  ^  ^2  ~  " 


c  -  d  +  1 


(a  +  1  )d 


•p).  Notice  that  the  norms  of  both  these 


1-ac-d^  1-ac-d^ 

points  converge  to  zero  as  ^  goes  to  zero,  that  is,  both  lIPj^ll  -+  0 
and  IIP2II  ^  n  -*  0 ,  Hence,  the  period  2  attractor  shrinks  to  a 

point  as  goes  to  zero;  this  point  to  which  the  period  2 

attractor  converges  is  the  fixed  point  of  GL  at  /j  =  0 . 

r* 

Now  assume  =  0 .  Assume  p^  =  is  any  initial  value  with 

Vq  ^  0,  then  Xq  :S  0  implies  y^  -  0,  and  Xq  >  0  implies  =  cXq 
yielding  y2  =  0.  Hence,  it  is  sufficient  to  consider  points  on  the 
X-axis.  Let  p^  =  (  Xq  ,  0 )  be  given.  If  Xq  <  0  then  Pj^  =  ( ax^ ,  0 ) 
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which  is  on  the  positive  X-axis.  If  Xq  =  0  then  p,  =  ( aXg , 0 )  and 
so  Pq  is  the  fixed  point  of  GLq  .  If  Xq  >  0,  then  =  <  cXq  ,  )  , 

and  P2  =  ((ac+d)xQ,  0).  Consequently  the  point  Aq  =  (0,0)  is  a 
globally  stable  fixed  point  of  GLq,  since  -1  <  ac  +  d  <  0. 

Now  assume  /i  >  0 .  The  fixed  point  ^ 

unstable  with  complex  eigenvalues  since  it  was  assumed  -d  >  1  and 
2 

c  +  4d  <  0.  Assume  Pq  =  (xQ,yQ)  is  any  initial  value  with  yQ  ^  0. 

Then  Xq  i  0  implies  y^  =  0,  and  if  Xq  2;  then  x^  =  cXq  +  yQ  + 

/j  ^  0  and  so  y2  =  0.  If  0  <  Xq  <  ~~"U  then  x^^  =  cXq  +  Xq  ^ 

y^  =  dxQ  <  0;  hence,  if  Xj^  <:  0  then  y2  =  0,  else  if  x^^  >  0  (and  so 

2 

0  s  -yQ  <  /j  +  CXq),  X2  =  cx^  +  y^  +  M  =  c  Xq  +  cyQ  +  c/j  +  dxQ  +  |j 
2 

<  (c  -  c(^  +  CXq)  +  cfi  +  dxQ  +  /i  =  dxQ  +  ^  <  0,  and  so  y^  =  0. 
Therefore,  it  is  sufficient  to  consider  points  on  the  X-axis. 

Let  Pq  =  (XQ,yQ)  s  (Xq,0)  be  any  point  on  the  X-axis.  If  Xq  <,  0 
then  p^  =  GL^(Pq)  =  (axQ  +  jj,  0)  =  (x^,yj),  so  x^  >  0.  Every  point 
qQ  =  (Wq,0)  such  that  Wq  <  Xq  ^  0  satisfies  =  GL^(qQ)  =  ( aw^^  + 

/j,  0)  =  (WpZ^),  so  Wj^  >  Xj  >  0.  The  conclusion  is  that  pomes 
on  the  X-axis  to  the  left  of  Aq  =  (0,0)  are  mapped  monotonicai ly 
into  the  X-axis  to  the  right  of  (/i,0). 

Let  Pq  =  (0,0).  A  simple  computation  shows  Pj^  =  (/j,  0),  P2  = 

((1+c)^,  d^),  Pq  =  ({ac  +  a  +  d  +  l);i,  0),  and  p^  =  (ax^  +  fj,  0). 

Notice  Xq  <  0,  hence  >  n  =  x^.  Recall  that  Pq  =  Aq  ,  Pj^  " 

=  Aq  .  Pq  =  Aq,  and  p^  =  A^ .  The  conclusion  is  that  Aq  ,  Aj^,  Aq  ,  and 

A^  are  on  the  X-axis,  and  Aq  is  to  the  left  of  Aq ,  and  both  A^  and 
A^  are  to  the  right  of  Aq  with  A^^  between  Aq  and  A^ . 

Let  Pq  =  (Xq,0)  be  any  point  on  the  X-axis  for  which  Xq  >  0. 
Then  p^  =  (  cXq  +  /j,  cIXq  ) .  Notice  that  if  Xq  =  then  x^^  =  0  and 

y^  =  Write  Bq  =  (-i-^,  0),  =  GL^(Bq),  Bq  =  GL^(B^),  and 


~  Bg  =  ((l-^)/J,  0),  and  B^  = 

([a(l-— )  +  1]^,  0).  Notice  that  denotes  the  point  on  the  Y-axis 
at  which  the  line  segment  [A^^jAg]  intersects  the  Y-axis,  and  that 
B2  is  a  point  on  the  X-axis  to  the  left  of  Aq.  The  assumptions  -a 

>  1  and  0  <  a(ac  +  d)  <  1  imply  ac  +  d  <  0  and  we  obtain  that  the 

point  A^  =  ((ac  +  a  +  d  +  l))i,  0)  is  on  the  X-axis  to  the  left  of 
* 

The  image  of  the  half  line  [A^.od)  through  A2  under  the  map  GL^ 
is  the  kinked  half  line  [A2,B2J  U  [B2,®)  through  A3.  The  image  of 
this  kinked  half  line  is  on  the  X-axis.  In  particular,  the  image 

of  the  half  line  [B2,®)  through  A3  is  (B3,'»)  on  the  X-axis  to  the 

right  of  Aj^  =  (;j,0),  and  the  image  of  the  line  segment  [A2,B2l  is 

Let  Pq  =  (Xq,0)  be  any  point  on  the  X-axis.  Straightforward 

computation  shows  the  following.  If  Xq  i  -l./j  (that  is,  p^  is  to 
the  right  of  Bq)  then  p^  =  (cXq  +  ji,  dx^ )  ,  P2  =  ([ac  +  d]x^  + 
(a+l);j,  0/,  and  P3  =  (a[ac  +  d]xQ  +  [a(a+l)  +  1  ] -/j,  0).  Hence,  both 
P2  and  P3  are  on  the  X-axis  for  Xq  i  If  0  i  Xq  i  -—/j  (that 

is,  Pq  is  on  the  X-axis  between  Aq  and  Bq  )  then  Pj^  =  (cXq  +  u, 

)  ,  P2  =  ([c  +  d)xQ  +  (c  +  l)/.j,  cdxQ  +  dp),  and  since  (c'^  +  dlxQ  + 

d  d 

(c+l)p  <  -cp  -  — p  +  cp  +  p  =  (1-— )p  <  0 ,  we  have 
2 

P3  =  ([ac  +  ad  +  cd]xQ  +  [ac  +  a  +  d  +  l}p,  0),  so  the  point  P3 
is  on  the  X-axis.  If  Xq  <  0  then  p^  =  ( axQ  +  p,  0),  P2  =  (acXy  + 
(c+l)p,  adxQ  +  dp),  and  P3  =  (a[ac  +  d]xQ  +  [ac  f  a  +  d  +  l]p,  0), 
so  the  point  P3  is  on  the  X-axis.  The  conclusion  is  that  for  each 
point  Pq  =  ( Xq , 0 )  on  the  X-axis,  the  third  iterate  of  Pq  is  also 
on  the  X-axis,  that  is,  GL^^(Pq)  =  (X3,  0).  Hence,  a  return  map 
of  GL^  exists  on  the  X-axis.  We  call  this  return  map  H,  so  H(x)  = 
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GL  (x,0).  The  above  results  imply 
2 

H(x)  =  (ac  +  ad)x  +  (ac  +  a  +  d  +  l)-/j  forx  <  0, 

2  1 
H(x)  =  ( ac  +  ad  +  cd)x  +  ( ac  +  a  +  d  +  1)-/J  for  0  ^  x  ^ - n,  and 

2  2  1 
H(x)  =  (a  c  +  ad)x  +  (a  +  a  +  l)-/j  for  Xq  2:  The  graph  of  H 

is  similar  to  figure  12.  The  map  H  has  three  fixed  points,  namely 


-  ( ac  +  a  +  d  +  1 ) 


u  "  c(ac+d)  +  ad  -  1 


ac  +  a  +  d+1 
“  1  -  a(ac+d)  ^  ^ 

a  ^  ^  a  ^  1. 

>  0.  The  fixed  point  p^  is  unstable  since  the  slope 

2 

ac  +  ad  +  cdof  H  in  p^  is  bigger  than  1,  and  the  two  fixed  points 

2 

q  and  p  is  stable  since  the  slope  a  c  +  ad  of  H  at  both  q  and 

S  S  5 

p  is  between  0  and  1.  Furthermore,  for  ail  x  with  x  <  p  we  have 

lim  H^(x)  =  q  ,  and  for  all  x  with  x  >  p  we  have  lim  h‘^(x)  =  p^. 
n-»oo  s  u  n-wD  s 

The  properties  (1)  H  has  slope  between  0  and  1  for  x  <  0, 

(2)  H  has  slope  bigger  than  1  ^'or  0  <  x  <  (3)  H  has  slope 

between  0  and  1  for  x  >  -/J,  and  (4)  H(0)  <  0  and 

imply  that  GL  has  a  period  3  attractor  consisting  of  the  points 

^  2 
-  ,ac  +  a  +  d+  l  r,\o  ,a+a+l 

-  (  1  -  a(ac+d)  ^  ^2^"  ^  1  -  aUc+d)'^  ’  ^ 

S„  =  {[c4 — --'f  'Ti-  +  ll-ii  .  d--? — 14— Notice  that  the 

norms  of  all  three  points  converge  to  zero  as  p  goes  to  zero,  that 

is,  ail  three  IlSj^lj  0,  IIS2II  -*  0,  and  HS^II  0  as  p  0 .  Hence, 

the  period  3  attractor  shrinks  to  a  point  as  /j  goes  to  zero;  this 

point  to  which  the  period  3  attractor  converges  is  the  fixed  point 


of  GL  at  u  =  0 . 

The  point  (P^i  0)  is  a  point  of  a  period  3  orbit  which  is  a 
regular  saddle  of  the  map  GL^.  We  conclude:  at  ^  =  0 ,  there  is  a 
"period  two  to  period  three"  border-collision  bifurcation.  This 
completes  the  proof  of  the  Proposition. 
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5.  DISCUSSION  AND  CONCLUDING  REMARKS. 

We  hr.ve  presented  bifurcation  phenomena,  which  we  call 
"border-collision  bifurcations".  These  bifurcations  occur  when  the 
nature  of  a  fixed  point  (or  periodic  point)  of  a  piecewise  smooth 
system  changes  when  it  collides  with  the  border  of  two  regions.  An 
interesting  case  occurs  when  the  fixed  point  changes  from  being  a 
flip  saddle  to  a  repellor  with  complex  eigenvalues >at  the 
parameter  value  where  it  collides  with  the  border  of  two  regions. 
We  have  presented  a  variety  of  examples  based  on  the  piecewise 
linear  map  and  the  Henon  map.  In  particular,  we  have  shown  the 
occurrence  of  a  "period  two  to  period  three"  border-collision 
bifurcation  for  maps  in  the  class  C, 

We  point  out  that  the  border-collision  bifurcation  can  be 
expected  to  occur  in  many  piecewise  smooth  models.  In  particular, 
the  "period  two  to  period  three"  bifurcation  phenomenon  can  be 
expected  to  occur  in  many  linear  models  with  constraints. 

Assume  for  the  piecewise  linear  map  that  the  fixed  point 
is  a  flip  saddle  in  the  left  half  plane  and  a  repellor  with 
complex  eigenvalues  in  the  right  half  plane. 

QUESTION  1.  Does  there  exist  a  classification  of  the  border- 
collision  bifurcations  for  P  in  the  case  where  a  period  2 
attractor  converges  to  the  fixed  point  (0,0)  when  ^  goes  to  0? 

QUESTION  2.  More  generally,  is  is  possible  to  give  a 
classification  of  the  border  collision  bifurcations  for  the 
piecewise  linear  map  P  ? 

QUESTION  3.  When  the  plane  is  subdivided  in  N  regions,  where  N 
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is  at  least  3,  do  there  exist  border-collision  bifurcations  that 
do  not  occur  when  there  are  only  2  regions,  and  in  particular 
bifurcations  that  persist  despite  small  perturbations? 


REFERENCES 

[AYY]  K.T,  Alligood,  E.D.  Yorke  and  J.A.  Yorke  (1987).  Why 
period-doubling  cascades  occur:  period  orbit  creation  followed  by 
stability  shedding.  Physica  28D,  197-205. 

(GHl  J.  Guckenheimer  and  P.  Holmes  (1983).  Nonlinear 
Oscillations ,  Dynamical  Systems .  and  Bifurcations  of  Vector 
Fields .  Applied  Mathematical  Sciences  42,  Springer-Verlag , 

New-York,  etc. 

[GOPY]  C.  Grebogi,  E.  Ott,  S.  Pelikan,  and  J.A.  Yorke  (1984). 
Strange  attractors  that  are  not  chaotic",  Physica  D  11,  261-268. 

[HNl  C.H.  Hommes  and  H.E.  Nusse  (1990).  "Period  three  to  perioo 
two"  bifurcation  for  piecewise  linear  models.  Submitted  for 
publication 

[HNS]  C.H.  Hommes,  H.E.  Nusse,  and  A.  Simonovits  (1990). 
Hicksian  cycles  and  chaos  in  a  socialist  economy.  Research 
memorandum  382,  Institute  of  Economic  Research,  University  of 
Groningen 

[K]  H.B.  Keller  (1987).  Numerical  methods  in  bifurcation 
problems .  Springer-Verlag,  Berlin,  etc. 

[MY]  J.  Mallet-Paret  and  J.A.  Yorke  (1982).  Snakes:  oriented 
families  of  periodic  orbits,  their  sources,  sinks  and  continuation 
J.  Differential  equations  43,  419-450 

[NY]  H.E.  Nusse  and  J.A.  Yorke  (1989).  A  procedure  for  finding 


31 


numerical  trajectories  on  chaotic  saddles.  Physica  36D,  137-156. 

(R]  D.  Ruelle  (1989).  Elements  of  Differentiable  Dynamics  and 
Bifurcation  Theory .  Academic  Press,  Inc.,  San  Diego  and  London 

[S]  R.  Seydel  (1988).  From  Equilibrium  to  Chaos .  Practical 
Bifurcation  and  Stability  Analysis .  Elsevier  Science  Publ.  Co., 
Inc.  New  York,  Amsterdam  and  London 

[Y]  J.A.  Yorke  (1990).  DYNAMICS:  An  interactive  program  for  IBM 
PC  clones. 


32 


